-- Logs begin at Sat 2021-12-11 20:01:09 UTC, end at Sat 2021-12-11 22:14:53 UTC. -- Dec 11 20:38:55.285191 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Dec 11 20:38:58.619656 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=134000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 11 20:38:58.620269 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=134000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 11 20:38:59.004965 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_db.sqlalchemy.engines [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:38:59.326510 ncdv-master-1 cinder-volume[134000]: INFO cinder.rpc [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Dec 11 20:38:59.330861 ncdv-master-1 cinder-volume[134000]: INFO cinder.rpc [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Dec 11 20:38:59.338999 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_db.sqlalchemy.engines [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:38:59.403192 ncdv-master-1 cinder-volume[134000]: INFO cinder.volume.manager [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Determined volume DB was empty at startup. Dec 11 20:38:59.403966 ncdv-master-1 cinder-volume[134000]: DEBUG cinder.volume.manager [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=134000) __init__ /opt/stack/cinder/cinder/volume/manager.py:281}} Dec 11 20:38:59.413580 ncdv-master-1 cinder-volume[134000]: INFO cinder.volume.manager [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Service not found for updating active_backend_id, assuming default for driver init. Dec 11 20:38:59.414679 ncdv-master-1 cinder-volume[134000]: WARNING stevedore.named [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:38:59.415507 ncdv-master-1 cinder-volume[134000]: WARNING castellan.key_manager [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:38:59.416877 ncdv-master-1 cinder-volume[134000]: WARNING cinder.keymgr.conf_key_mgr [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:38:59.434430 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_db.sqlalchemy.engines [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:38:59.439237 ncdv-master-1 cinder-volume[134000]: INFO cinder.rpc [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Dec 11 20:38:59.443924 ncdv-master-1 cinder-volume[134000]: INFO cinder.rpc [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Automatically selected cinder-volume RPC version 3.16 as minimum service version. Dec 11 20:38:59.444758 ncdv-master-1 cinder-volume[134000]: WARNING stevedore.named [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:38:59.445272 ncdv-master-1 cinder-volume[134000]: WARNING castellan.key_manager [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:38:59.447519 ncdv-master-1 cinder-volume[134000]: INFO cinder.volume.manager [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Image-volume cache enabled for host ncdv-master-1@ceph. Dec 11 20:38:59.453671 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_db.sqlalchemy.engines [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:38:59.475443 ncdv-master-1 cinder-volume[134000]: INFO oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Starting 1 workers Dec 11 20:38:59.481099 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Started child 134173 {{(pid=134000) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 11 20:38:59.482355 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Full set of CONF: {{(pid=134000) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 11 20:38:59.482876 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ******************************************************************************** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 11 20:38:59.483279 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] Configuration options gathered from: {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 11 20:38:59.483882 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 11 20:38:59.484764 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 11 20:38:59.485280 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ================================================================================ {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 11 20:38:59.486188 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] allow_availability_zone_fallback = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.487065 ncdv-master-1 cinder-volume[134173]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Dec 11 20:38:59.487595 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] allow_compression_on_image_upload = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.487797 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] allowed_direct_url_schemes = [] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.488340 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] api_rate_limit = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.488899 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] auth_strategy = keystone {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.489597 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] az_cache_duration = 3600 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.490194 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_availability_zone = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.490949 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_host = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.491552 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_name = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.492188 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_stats_polling_interval = 60 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.492797 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backup_api_class = cinder.backup.api.API {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.493365 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.493980 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backup_name_template = backup-%s {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.494638 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backup_use_same_host = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.495247 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backup_use_temp_snapshot = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.495844 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] chap_password = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.496435 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] chap_username = {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.497315 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.497955 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cinder_internal_tenant_project_id = 0fa26583c3854499bf9a64bce9b104c1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.498602 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cinder_internal_tenant_user_id = 206c81b5fd6548d9894b69b752029642 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.499234 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cloned_volume_same_az = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.499801 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cluster = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.500390 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] compression_format = gzip {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.501048 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] compute_api_class = cinder.compute.nova.API {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.501771 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] config_dir = [] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.502288 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.502933 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] config_source = [] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.503531 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.504144 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] control_exchange = openstack {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.504768 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] debug = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.505903 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] default_availability_zone = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.506469 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] default_group_type = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.507688 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.508309 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] default_volume_type = ceph {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.509027 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] driver_client_cert = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.509624 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] driver_client_cert_key = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.510250 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] driver_data_namespace = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.510887 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] driver_ssl_cert_path = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.511626 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] driver_ssl_cert_verify = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.512258 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] driver_use_ssl = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.512829 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] enable_force_upload = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.513373 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] enable_new_services = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.513936 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] enable_unsupported_driver = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.514621 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] enabled_backends = ['ceph'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.515194 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] enforce_multipath_for_image_xfer = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.515773 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] filter_function = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.516374 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] glance_api_insecure = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.517089 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] glance_api_servers = ['http://10.222.0.18/image'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.517771 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] glance_api_ssl_compression = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.518322 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] glance_ca_certificates_file = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.518973 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] glance_catalog_info = image:glance:publicURL {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.520035 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] glance_certfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.520287 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.520963 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] glance_keyfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.522068 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] glance_num_retries = 3 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.522682 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] glance_request_timeout = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.523260 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] goodness_function = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.523839 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] graceful_shutdown_timeout = 5 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.524417 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] group_api_class = cinder.group.api.API {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.524986 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] host = ncdv-master-1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.525557 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] iet_conf = /etc/iet/ietd.conf {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.526192 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] image_compress_on_upload = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.526804 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] image_conversion_address_space_limit = 1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.527680 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] image_conversion_cpu_limit = 60 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.528033 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Starting volume driver RBDDriver (1.2.0) Dec 11 20:38:59.528628 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.529273 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] image_upload_use_cinder_backend = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.529843 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] image_upload_use_internal_tenant = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.529992 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:38:59.530496 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] image_volume_cache_enabled = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.531058 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] image_volume_cache_max_count = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.531643 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] image_volume_cache_max_size_gb = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.532234 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] init_host_max_objects_retrieval = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.532907 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] instance_format = [instance: %(uuid)s] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.533506 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.534095 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] iscsi_iotype = fileio {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.534700 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] iscsi_secondary_ip_addresses = [] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.535311 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] iscsi_target_flags = {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.535866 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] iscsi_write_cache = on {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.536430 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] iser_helper = tgtadm {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.537488 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] iser_ip_address = 10.222.0.18 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.538211 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] iser_port = 3260 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.538797 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.539397 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] log_config_append = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.540012 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.540582 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] log_dir = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.541128 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] log_file = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.541634 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] log_options = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.542205 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] log_rotate_interval = 1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.542828 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] log_rotate_interval_type = days {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.543495 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] log_rotation_type = none {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.544000 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.544500 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.545158 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.545757 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.546252 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.546869 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] max_age = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.547612 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] max_logfile_count = 30 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.548300 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] max_logfile_size_mb = 200 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.548891 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] max_over_subscription_ratio = 20.0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.549486 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] message_reap_interval = 86400 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.550045 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] message_ttl = 2592000 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.550670 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] migration_create_volume_timeout_secs = 300 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.551234 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] monkey_patch = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.551796 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] monkey_patch_modules = [] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.552908 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] my_ip = 10.222.0.18 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.553503 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] no_snapshot_gb_quota = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.554075 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] num_iser_scan_tries = 3 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.554704 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] num_shell_tries = 3 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.555253 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] num_volume_device_scan_tries = 3 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.555869 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] nvmet_ns_id = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.556417 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] nvmet_port_id = 1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.556997 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] osapi_max_limit = 1000 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.557820 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] osapi_volume_ext_list = [] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.558585 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.559187 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] osapi_volume_listen = 0.0.0.0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.559796 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] osapi_volume_listen_port = 8776 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.560342 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] osapi_volume_use_ssl = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.560920 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] osapi_volume_workers = 2 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.561532 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] per_volume_size_limit = -1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.562098 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] periodic_fuzzy_delay = 60 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.562689 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] periodic_interval = 60 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.563274 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] public_endpoint = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.563919 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] publish_errors = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.564599 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] quota_backup_gigabytes = 1000 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.565177 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] quota_backups = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.565732 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] quota_consistencygroups = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.566306 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.566958 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] quota_gigabytes = 1000 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.567546 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] quota_groups = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.568883 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] quota_snapshots = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.569520 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] quota_volumes = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.570091 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] rate_limit_burst = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.570679 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] rate_limit_except_level = CRITICAL {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.571263 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] rate_limit_interval = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.571861 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] reinit_driver_count = 3 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.572431 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] replication_device = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.573008 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] report_discard_supported = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.573643 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] report_interval = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.574442 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] reservation_clean_interval = 86400 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.574978 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] reservation_expire = 86400 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.575613 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] reserved_percentage = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.576243 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.576824 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.577419 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] rpc_response_timeout = 120 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.578117 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] run_external_periodic_tasks = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.578887 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.579468 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] scst_target_driver = iscsi {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.580060 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] scst_target_iqn_name = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.580570 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] service_down_time = 60 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.581244 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] snapshot_name_template = snapshot-%s {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.581839 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] snapshot_same_host = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.582572 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] split_loggers = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.583079 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] state_path = /opt/stack/data/cinder {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.583700 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] storage_availability_zone = nova {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.584264 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] storage_protocol = iscsi {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.585005 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] syslog_log_facility = LOG_USER {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.585656 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] target_helper = lioadm {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.586314 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] target_ip_address = 10.222.0.18 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.586952 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] target_port = 3260 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.587530 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.588274 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] target_protocol = iscsi {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.588949 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] trace_flags = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.589536 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] transfer_api_class = cinder.transfer.api.API {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.590098 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] transport_url = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.590687 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] until_refresh = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.591264 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] use_chap_auth = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.591809 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] use_default_quota_class = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.592363 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] use_eventlog = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.592476 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:38:59.593312 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] use_journal = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.593880 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] use_json = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.594436 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] use_multipath_for_image_xfer = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.595011 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] use_stderr = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.595552 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] use_syslog = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.596181 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] verify_glance_signatures = enabled {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.596744 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volume_api_class = cinder.volume.api.API {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.597298 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volume_backend_name = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.597896 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volume_clear = zero {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.598689 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volume_clear_ionice = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.599388 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volume_clear_size = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.599966 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.600544 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volume_copy_bps_limit = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.601124 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volume_dd_blocksize = 1M {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.601734 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.602296 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volume_name_template = volume-%s {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.602867 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volume_service_inithost_offload = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.603445 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volume_usage_audit_period = month {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.604105 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.604650 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] watch_log_file = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.605193 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] zoning_mode = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 11 20:38:59.605904 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.606527 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.607188 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_policy.enforce_new_defaults = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.607758 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_policy.enforce_scope = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.608357 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_policy.policy_default_rule = default {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.609685 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.610304 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_policy.policy_file = policy.yaml {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.610951 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.611523 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.612156 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.612711 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.613280 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.613898 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_concurrency.disable_process_locking = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.614386 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.615475 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.admin_password = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.615913 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.616491 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.admin_token = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.617033 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.admin_user = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.617514 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.auth_admin_prefix = {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.618009 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.618507 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.auth_port = 35357 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.619197 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.auth_protocol = https {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.619819 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.auth_section = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.620811 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.auth_type = password {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.621028 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:38:59.621307 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.auth_uri = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.621741 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.auth_version = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.622153 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.cache = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.622618 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.623034 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.certfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.623453 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.delay_auth_decision = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.623920 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.624349 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.http_connect_timeout = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.624768 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.625180 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.identity_uri = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.625595 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.include_service_catalog = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.626030 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.insecure = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.626449 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.interface = public {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.626878 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.keyfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.627292 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.627727 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.628172 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.628585 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.629039 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.629444 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.629869 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.630917 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.631697 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.632528 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.region_name = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.632831 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.633283 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.service_token_roles_required = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.633899 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.service_type = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.634500 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.token_cache_time = 300 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.635081 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.635742 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.backend = dogpile.cache.null {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.636306 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.backend_argument = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.636894 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.config_prefix = cache.oslo {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.637321 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.debug_cache_backend = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.637747 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.enabled = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.638305 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.expiration_time = 600 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.640788 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.memcache_dead_retry = 300 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.641327 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.641827 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.642206 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.memcache_pool_maxsize = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.642716 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.643007 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.643422 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.memcache_socket_timeout = 1.0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.643784 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.proxies = [] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.644162 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.tls_allowed_ciphers = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.644498 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.tls_cafile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.644899 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.tls_certfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.645217 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.tls_enabled = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.645574 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cache.tls_keyfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.645989 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] coordination.backend_url = etcd3+http://10.222.0.18:2379 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.646434 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.backend = sqlalchemy {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.648800 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.connection = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.649193 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.connection_debug = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.649716 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.connection_parameters = {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.650226 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.connection_recycle_time = 3600 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.650767 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.connection_trace = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.651263 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.db_inc_retry_interval = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.651779 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.db_max_retries = 20 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.652281 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.db_max_retry_interval = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.653120 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.db_retry_interval = 1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.654608 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.max_overflow = 50 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.655745 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.max_pool_size = 5 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.656276 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.max_retries = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.656774 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.mysql_enable_ndb = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.657292 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.657785 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.pool_timeout = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.657883 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.driver [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Driver hasn't implemented _init_vendor_properties() Dec 11 20:38:59.658181 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.driver [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:6e8f856c-f0dd-4f2b-b584-866af3a1c6ae:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134173) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:820}} Dec 11 20:38:59.658583 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.retry_interval = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.659097 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.slave_connection = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.659585 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.sqlite_synchronous = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.660076 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] database.use_db_reconnect = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.660627 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.661131 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.661675 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.662201 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.662746 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.663289 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] profiler.connection_string = messaging:// {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.663722 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] profiler.enabled = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.664247 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] profiler.es_doc_type = notification {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.664738 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] profiler.es_scroll_size = 10000 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.665258 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] profiler.es_scroll_time = 2m {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.665814 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] profiler.filter_error_trace = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.666318 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] profiler.hmac_keys = SECRET_KEY {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.666926 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] profiler.sentinel_service_name = mymaster {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.667442 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] profiler.socket_timeout = 0.1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.667914 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] profiler.trace_sqlalchemy = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.668494 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] privsep_osbrick.capabilities = [21] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.668896 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] privsep_osbrick.group = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.670051 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] privsep_osbrick.helper_command = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.670051 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.670051 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.670320 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] privsep_osbrick.user = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.670732 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.671237 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cinder_sys_admin.group = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.671737 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cinder_sys_admin.helper_command = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.672238 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.672719 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.673210 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] cinder_sys_admin.user = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.673704 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] service_user.auth_section = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.674183 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] service_user.auth_type = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.674709 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] service_user.cafile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.675191 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] service_user.certfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.675735 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] service_user.collect_timing = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.676077 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] service_user.insecure = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.676415 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] service_user.keyfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.676787 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] service_user.send_service_user_token = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.677698 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] service_user.split_loggers = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.678045 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] service_user.timeout = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.678445 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.backend_availability_zone = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.678854 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.679181 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:38:59.679294 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.679549 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.chap_password = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.679902 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.chap_username = {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.680413 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.680913 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.681415 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.681913 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.driver_client_cert = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.682398 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.driver_client_cert_key = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.682935 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.driver_data_namespace = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.683424 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.683919 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.684409 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.driver_use_ssl = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.684904 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.enable_deferred_deletion = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.685409 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.enable_unsupported_driver = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.685928 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.686449 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.extra_capabilities = {} {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.686974 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.filter_function = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.687459 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.goodness_function = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.687961 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.688460 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.688972 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.689458 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.689941 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.690448 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.690973 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.iscsi_iotype = fileio {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.691485 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.692002 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.iscsi_target_flags = {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.692513 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.iscsi_write_cache = on {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.693587 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.iser_helper = tgtadm {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.694273 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.iser_ip_address = 10.222.0.18 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.694818 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.iser_port = 3260 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.695327 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.695828 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.696326 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.696824 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.num_shell_tries = 3 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.697321 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.697885 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.698375 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.nvmet_port_id = 1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.698908 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.699412 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.rados_connection_interval = 5 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.699913 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.rados_connection_retries = 3 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.700399 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.rbd_ceph_conf = {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.700922 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.701442 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.701943 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.702450 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.702984 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.rbd_pool = rbd {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.703479 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.rbd_secret_uuid = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.703968 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.704459 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.rbd_user = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.704950 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.705446 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.replication_device = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.705951 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.report_discard_supported = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.706458 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.706844 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.reserved_percentage = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.707207 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.scst_target_driver = iscsi {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.707544 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.scst_target_iqn_name = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.707912 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.storage_protocol = iscsi {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.708282 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.708672 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.target_helper = tgtadm {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.709167 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.target_ip_address = 10.222.0.18 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.709521 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.target_port = 3260 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.709885 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.710243 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.target_protocol = iscsi {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.710613 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.trace_flags = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.710998 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.unique_fqdn_network = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.711347 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.use_chap_auth = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.711690 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.712038 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.volume_backend_name = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.712396 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.volume_clear = zero {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.712732 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.volume_clear_ionice = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.713079 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.volume_clear_size = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.713442 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.713789 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.714145 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.715716 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.715716 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.715716 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_reports.file_event_handler = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.715716 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.716044 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_reports.log_dir = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.716560 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.backend_availability_zone = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.717058 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.backend_host = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.718513 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.backend_native_threads_pool_size = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.718513 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.backup_use_temp_snapshot = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.718513 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.chap_password = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.718759 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.chap_username = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.719040 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.chiscsi_conf = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.719360 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.deferred_deletion_delay = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.719700 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.deferred_deletion_purge_interval = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.720036 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.driver_client_cert = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.720374 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.driver_client_cert_key = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.720717 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.driver_data_namespace = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.720966 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.db.sqlalchemy.api [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Building query based on filter {{(pid=134173) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3156}} Dec 11 20:38:59.721081 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.driver_ssl_cert_path = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.721406 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.driver_ssl_cert_verify = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.721746 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.driver_use_ssl = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.722094 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.enable_deferred_deletion = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.722429 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.enable_unsupported_driver = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.722812 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.723153 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.extra_capabilities = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.723486 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.filter_function = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.723828 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.goodness_function = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.724193 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.iet_conf = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.724529 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.image_upload_use_cinder_backend = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.724864 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.image_upload_use_internal_tenant = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.725222 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.image_volume_cache_enabled = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.725561 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.image_volume_cache_max_count = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.725898 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.726236 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.iscsi_iotype = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.726637 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.727144 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.iscsi_target_flags = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.727631 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.iscsi_write_cache = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.728101 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.iser_helper = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.728590 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.iser_ip_address = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.729082 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.iser_port = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.729589 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.iser_target_prefix = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.730141 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.max_over_subscription_ratio = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.730646 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.num_iser_scan_tries = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.731148 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.num_shell_tries = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.731635 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.num_volume_device_scan_tries = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.732117 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.nvmet_ns_id = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.732606 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.nvmet_port_id = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.733774 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.rados_connect_timeout = -1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.734268 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.rados_connection_interval = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.734774 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.rados_connection_retries = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.735269 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.735757 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.rbd_cluster_name = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.736252 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.736772 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.737272 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.rbd_max_clone_depth = 5 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.737769 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.rbd_pool = volumes {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.738264 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.rbd_secret_uuid = 165df680-4878-464e-9553-140cfde358a5 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.738786 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.rbd_store_chunk_size = 4 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.739265 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.rbd_user = cinder {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.740266 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.replication_connect_timeout = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.740616 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.replication_device = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.740959 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.report_discard_supported = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.741300 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.report_dynamic_total_capacity = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.741647 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.reserved_percentage = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.741985 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.scst_target_driver = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.742348 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.scst_target_iqn_name = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.742722 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.storage_protocol = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.743063 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.743382 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.target_helper = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.743868 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.target_ip_address = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.744343 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.target_port = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.744823 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.target_prefix = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.744945 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.image_utils [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=134173) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Dec 11 20:38:59.745422 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.target_protocol = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.746774 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.trace_flags = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.747258 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.unique_fqdn_network = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.747725 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.use_chap_auth = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.748193 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.use_multipath_for_image_xfer = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.748675 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.volume_backend_name = ceph {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.749171 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.volume_clear = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.749655 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.volume_clear_ionice = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.750122 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.volume_clear_size = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.750652 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.751127 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.volume_copy_bps_limit = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.751609 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.volume_dd_blocksize = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.752085 ncdv-master-1 cinder-volume[134173]: INFO cinder.keymgr.migration [None req-5738d781-562c-4df6-a24d-52a8e1de8458 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Dec 11 20:38:59.752289 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.752754 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ceph.volumes_dir = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.753343 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.753861 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.754420 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.754938 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.756002 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.756509 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.757033 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.757544 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.758019 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.758537 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.759057 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.759572 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.760108 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.760602 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.760810 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:38:59.761251 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.761764 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.762311 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.762843 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.763340 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.763829 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.764312 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.765875 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.ssl = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.766391 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.766928 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.767430 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.767927 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_rabbit.ssl_version = {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.768365 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_notifications.driver = [] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.768868 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_notifications.retry = -1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.769434 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.770000 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] oslo_messaging_notifications.transport_url = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.770463 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.770775 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] key_manager.fixed_key = **** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.771210 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.771556 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.barbican_api_version = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.771904 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.barbican_endpoint = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.772289 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.barbican_endpoint_type = public {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.772625 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.barbican_region_name = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.772960 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.cafile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.773294 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.certfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.773640 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.collect_timing = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.773978 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.insecure = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.774318 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.keyfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.774694 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.number_of_retries = 60 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.775279 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.retry_delay = 1 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.775442 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.send_service_user_token = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.775712 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.split_loggers = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.776221 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.timeout = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.776867 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.verify_ssl = True {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.777771 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican.verify_ssl_path = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.778145 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican_service_user.auth_section = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.778530 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican_service_user.auth_type = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.779287 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican_service_user.cafile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.779612 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican_service_user.certfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.780267 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican_service_user.collect_timing = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.780584 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican_service_user.insecure = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.781017 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican_service_user.keyfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.781365 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican_service_user.split_loggers = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.781711 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] barbican_service_user.timeout = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.782067 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.approle_role_id = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.782424 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.approle_secret_id = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.782793 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.cafile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.783131 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.certfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.783480 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.collect_timing = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.783822 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.insecure = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.784156 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.keyfile = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.784520 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.kv_mountpoint = secret {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.784871 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.kv_version = 2 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.785213 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.namespace = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.785554 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.root_token_id = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.785892 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.split_loggers = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.786660 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.ssl_ca_crt_file = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.787143 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.timeout = None {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.787617 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.use_ssl = False {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.788221 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 11 20:38:59.788575 ncdv-master-1 cinder-volume[134000]: DEBUG oslo_service.service [None req-14399446-8c0a-49d7-ba68-5cae9eefa283 None None] ******************************************************************************** {{(pid=134000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 11 20:38:59.803596 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:38:59.832170 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:38:59.868890 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Driver initialization completed successfully. Dec 11 20:38:59.878718 ncdv-master-1 cinder-volume[134173]: INFO cinder.manager [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Initiating service 3 cleanup Dec 11 20:38:59.886996 ncdv-master-1 cinder-volume[134173]: INFO cinder.manager [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Service 3 cleanup completed. Dec 11 20:38:59.886996 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.service [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Creating RPC server for service cinder-volume {{(pid=134173) start /opt/stack/cinder/cinder/service.py:231}} Dec 11 20:38:59.895513 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.service [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=134173) start /opt/stack/cinder/cinder/service.py:237}} Dec 11 20:38:59.959249 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Dec 11 20:38:59.960165 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:38:59.985476 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:39:00.049212 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1a026d42-b469-4818-9150-11bd550ff135 None None] Driver post RPC initialization completed successfully. Dec 11 20:40:55.052375 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:40:55.053154 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:40:55.075205 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:40:55.099177 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:41:55.057025 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:41:55.057698 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:41:55.082861 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:41:55.105393 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:42:55.060106 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:42:55.060750 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:42:55.082724 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:42:55.103727 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:43:55.059491 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:43:55.060133 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:43:55.081419 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:43:55.103142 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:44:55.058202 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:44:55.058931 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:44:55.080139 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:44:55.101212 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:45:55.056001 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:45:55.056817 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:45:55.082222 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:45:55.110917 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:46:55.056452 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:46:55.057143 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:46:55.083151 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:46:55.114496 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:47:55.057385 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:47:55.058213 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:47:55.136314 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:47:55.196376 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:48:55.053353 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:48:55.054023 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:48:55.115996 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:48:55.186316 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:48:55.317511 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:48:55.364974 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:48:55.371666 ncdv-master-1 cinder-volume[134173]: INFO cinder.rpc [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Dec 11 20:48:55.383246 ncdv-master-1 cinder-volume[134173]: INFO cinder.rpc [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Automatically selected cinder-backup RPC version 2.2 as minimum service version. Dec 11 20:48:55.385034 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:48:55.385589 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:48:55.470593 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Flow 'volume_create_manager' (84f27b44-c95b-43d2-aaa5-efa00db18430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:48:55.480952 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc869e1-1de2-4779-9ef5-fe8de1e593ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:48:55.499537 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:48:55.595581 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc869e1-1de2-4779-9ef5-fe8de1e593ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1664510926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9f8ce43b-7eb5-406f-8ca7-0888d91599b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab74ac5e278045cfabd33d4b53d45f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:48:55Z,use_quota=True,user_id='e66bb3787b3044a2bdd5b11008ef6b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:48:55.598153 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ec8700-81a0-4a76-9171-cb3f7256ffdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:48:55.616769 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ec8700-81a0-4a76-9171-cb3f7256ffdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:48:55.631439 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5406cb-627e-4e86-8f4e-19ac57d9784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:48:55.633879 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5406cb-627e-4e86-8f4e-19ac57d9784e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8ce43b-7eb5-406f-8ca7-0888d91599b0', 'volume_name': 'volume-9f8ce43b-7eb5-406f-8ca7-0888d91599b0', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:48:55.636963 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26dba3f-0c4a-435d-a596-89a7705aef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:48:55.639347 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26dba3f-0c4a-435d-a596-89a7705aef89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:48:55.641699 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78ad9e6-22cc-497a-83f6-f66cd3abebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:48:55.642531 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Volume 9f8ce43b-7eb5-406f-8ca7-0888d91599b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8ce43b-7eb5-406f-8ca7-0888d91599b0', 'volume_size': 1} Dec 11 20:48:55.642955 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] creating volume 'volume-9f8ce43b-7eb5-406f-8ca7-0888d91599b0' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:48:55.643947 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:48:55.855300 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:48:55.855821 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:48:55.859001 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78ad9e6-22cc-497a-83f6-f66cd3abebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8ce43b-7eb5-406f-8ca7-0888d91599b0', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:48:55.862755 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebfd2b0-901d-4c83-88b2-c0a1e1f4826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:48:55.890130 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Volume volume-9f8ce43b-7eb5-406f-8ca7-0888d91599b0 (9f8ce43b-7eb5-406f-8ca7-0888d91599b0): created successfully Dec 11 20:48:55.893435 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebfd2b0-901d-4c83-88b2-c0a1e1f4826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:48:55.899155 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Flow 'volume_create_manager' (84f27b44-c95b-43d2-aaa5-efa00db18430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:48:55.922145 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-03d13359-a278-4865-92d9-d8802fe0684e tempest-VolumesAdminNegativeTest-1681167821 None] Created volume successfully. Dec 11 20:48:58.237227 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-47102a05-5413-4103-980e-4677f7ece929 req-b587f67e-2f5a-425d-b408-4dd2a362e506 tempest-VolumesAdminNegativeTest-1681167821 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:48:59.504806 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-47102a05-5413-4103-980e-4677f7ece929 req-b587f67e-2f5a-425d-b408-4dd2a362e506 tempest-VolumesAdminNegativeTest-1681167821 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.267s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:48:59.505927 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-47102a05-5413-4103-980e-4677f7ece929 req-b587f67e-2f5a-425d-b408-4dd2a362e506 tempest-VolumesAdminNegativeTest-1681167821 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9f8ce43b-7eb5-406f-8ca7-0888d91599b0', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '9f8ce43b-7eb5-406f-8ca7-0888d91599b0', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:48:59.563063 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-47102a05-5413-4103-980e-4677f7ece929 req-b587f67e-2f5a-425d-b408-4dd2a362e506 tempest-VolumesAdminNegativeTest-1681167821 None] Connection info returned from driver {'name': 'volumes/volume-9f8ce43b-7eb5-406f-8ca7-0888d91599b0', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9f8ce43b-7eb5-406f-8ca7-0888d91599b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3095a99b-9a54-4a3b-b653-9f3bd6276376'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:48:59.704414 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-47102a05-5413-4103-980e-4677f7ece929 req-b587f67e-2f5a-425d-b408-4dd2a362e506 tempest-VolumesAdminNegativeTest-1681167821 None] attachment_update completed successfully. Dec 11 20:49:06.674068 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-354e6613-1102-4cd1-92cf-1a37667ef23e req-6b667dff-fabe-41f8-b7e1-ea8c1c03d3f1 tempest-VolumesAdminNegativeTest-1681167821 None] Terminate volume connection completed successfully. Dec 11 20:49:06.674939 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-354e6613-1102-4cd1-92cf-1a37667ef23e req-6b667dff-fabe-41f8-b7e1-ea8c1c03d3f1 tempest-VolumesAdminNegativeTest-1681167821 None] Deleting attachment 3095a99b-9a54-4a3b-b653-9f3bd6276376. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 20:49:09.224565 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:49:09.233776 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:49:09.234434 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:49:09.259904 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Flow 'volume_create_manager' (3b243f18-4434-4eae-8529-b89e09fc4510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:49:09.285273 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adea2651-8abb-4c03-a86b-f9442e611bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:49:09.293085 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:49:09.324474 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adea2651-8abb-4c03-a86b-f9442e611bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1280672233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c0cb7ce4-38ac-4075-b795-d05bb7337ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab74ac5e278045cfabd33d4b53d45f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:49:09Z,use_quota=True,user_id='e66bb3787b3044a2bdd5b11008ef6b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:49:09.328554 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4bd387-a83b-49c1-af54-44bbb85adcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:49:09.338851 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4bd387-a83b-49c1-af54-44bbb85adcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:49:09.344731 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307dffd1-5709-47d9-9add-59df6ebc71af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:49:09.351688 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307dffd1-5709-47d9-9add-59df6ebc71af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0cb7ce4-38ac-4075-b795-d05bb7337ff4', 'volume_name': 'volume-c0cb7ce4-38ac-4075-b795-d05bb7337ff4', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:49:09.361484 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef952cf8-679b-413a-a8c4-71a6657e095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:49:09.364327 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef952cf8-679b-413a-a8c4-71a6657e095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:49:09.366959 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b1b9f6-948e-47c9-b4fa-bb7e6031fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:49:09.368499 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Volume c0cb7ce4-38ac-4075-b795-d05bb7337ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0cb7ce4-38ac-4075-b795-d05bb7337ff4', 'volume_size': 1} Dec 11 20:49:09.369217 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] creating volume 'volume-c0cb7ce4-38ac-4075-b795-d05bb7337ff4' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:49:09.370662 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:09.507826 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:49:09.508606 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:49:09.512353 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b1b9f6-948e-47c9-b4fa-bb7e6031fc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0cb7ce4-38ac-4075-b795-d05bb7337ff4', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:49:09.515450 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13774da6-7cf4-49e0-a7b7-0a4aa750b269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:49:09.529595 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Volume volume-c0cb7ce4-38ac-4075-b795-d05bb7337ff4 (c0cb7ce4-38ac-4075-b795-d05bb7337ff4): created successfully Dec 11 20:49:09.532123 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13774da6-7cf4-49e0-a7b7-0a4aa750b269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:49:09.543139 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Flow 'volume_create_manager' (3b243f18-4434-4eae-8529-b89e09fc4510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:49:09.561116 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-baec5fb2-7037-4fbe-adc3-7f06019ea0bb tempest-VolumesAdminNegativeTest-1681167821 None] Created volume successfully. Dec 11 20:49:10.635127 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] Lock "b'cinder-c0cb7ce4-38ac-4075-b795-d05bb7337ff4-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:49:10.698255 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:10.786380 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 20:49:10.787513 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] Volume volume-c0cb7ce4-38ac-4075-b795-d05bb7337ff4 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:49:10.825487 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] deleting rbd volume volume-c0cb7ce4-38ac-4075-b795-d05bb7337ff4 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 20:49:11.120248 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Dec 11 20:49:11.121326 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Dec 11 20:49:11.148595 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] Created reservations ['e4bbb75f-2bee-48fc-b98a-3e7a71890ddc', '47b4757f-1c17-4690-ae63-789ecaef756b', '9eef0508-2007-41ce-b127-7ed52c836e30', '0eabf779-0ce9-461f-93c3-b690c922a904'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 20:49:11.252714 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:11.305129 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:11.366809 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:49:11.374833 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] Deleted volume successfully. Dec 11 20:49:11.389778 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-453e2acc-d1b8-4873-b5f1-6fb2228c8693 tempest-VolumesAdminNegativeTest-1681167821 None] Lock "b'cinder-c0cb7ce4-38ac-4075-b795-d05bb7337ff4-delete_volume'" released by "delete_volume" :: held 0.754s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:49:11.947056 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-dc2f86de-2b9d-4555-8c02-d89906991d80 tempest-VolumesAdminNegativeTest-1681167821 None] Lock "b'cinder-9f8ce43b-7eb5-406f-8ca7-0888d91599b0-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:49:12.033022 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dc2f86de-2b9d-4555-8c02-d89906991d80 tempest-VolumesAdminNegativeTest-1681167821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:12.122680 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dc2f86de-2b9d-4555-8c02-d89906991d80 tempest-VolumesAdminNegativeTest-1681167821 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 20:49:12.123560 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dc2f86de-2b9d-4555-8c02-d89906991d80 tempest-VolumesAdminNegativeTest-1681167821 None] Volume volume-9f8ce43b-7eb5-406f-8ca7-0888d91599b0 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:49:12.135224 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dc2f86de-2b9d-4555-8c02-d89906991d80 tempest-VolumesAdminNegativeTest-1681167821 None] deleting rbd volume volume-9f8ce43b-7eb5-406f-8ca7-0888d91599b0 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 20:49:12.472989 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-dc2f86de-2b9d-4555-8c02-d89906991d80 tempest-VolumesAdminNegativeTest-1681167821 None] Created reservations ['e44c74ea-9a21-4512-a1f0-c2e558bd7d6b', 'cf1467c8-63d4-4e16-b002-ce84bc10d4a3', '9c9e7322-9bdf-4e33-83d9-eeed1e0cb524', '50d69a50-7706-4d1e-9030-66123695ba44'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 20:49:12.548961 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dc2f86de-2b9d-4555-8c02-d89906991d80 tempest-VolumesAdminNegativeTest-1681167821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:12.656868 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dc2f86de-2b9d-4555-8c02-d89906991d80 tempest-VolumesAdminNegativeTest-1681167821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:12.731137 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-dc2f86de-2b9d-4555-8c02-d89906991d80 tempest-VolumesAdminNegativeTest-1681167821 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:49:12.736675 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-dc2f86de-2b9d-4555-8c02-d89906991d80 tempest-VolumesAdminNegativeTest-1681167821 None] Deleted volume successfully. Dec 11 20:49:12.761840 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-dc2f86de-2b9d-4555-8c02-d89906991d80 tempest-VolumesAdminNegativeTest-1681167821 None] Lock "b'cinder-9f8ce43b-7eb5-406f-8ca7-0888d91599b0-delete_volume'" released by "delete_volume" :: held 0.815s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:49:37.313788 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:49:37.321448 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:49:37.324026 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:49:37.353933 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Flow 'volume_create_manager' (384ebb54-6134-4bba-adc6-48857eace767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:49:37.359367 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db970cd-3b49-4ba8-93da-7ff05095682e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:49:37.385736 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:49:37.410107 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db970cd-3b49-4ba8-93da-7ff05095682e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-108617521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=02cbc06b-9ea4-4656-a459-2ec9f65983a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9db55288209440a08ca2840c9ee07a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:49:37Z,use_quota=True,user_id='64b7c054aae14056a5ec4c9f998b7d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:49:37.412999 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d05073c-d631-4e54-abae-c9bae5f32a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:49:37.416893 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d05073c-d631-4e54-abae-c9bae5f32a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:49:37.421108 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6800bd7-1b6d-4caa-978b-d22e232dc5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:49:37.424745 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6800bd7-1b6d-4caa-978b-d22e232dc5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02cbc06b-9ea4-4656-a459-2ec9f65983a3', 'volume_name': 'volume-02cbc06b-9ea4-4656-a459-2ec9f65983a3', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:49:37.428391 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb4e367-183a-4ee0-a3f1-27767fe3ec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:49:37.436262 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb4e367-183a-4ee0-a3f1-27767fe3ec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:49:37.440828 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69aa7712-7ebf-4a01-a4e0-7608c0b13112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:49:37.441784 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Volume 02cbc06b-9ea4-4656-a459-2ec9f65983a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02cbc06b-9ea4-4656-a459-2ec9f65983a3', 'volume_size': 1} Dec 11 20:49:37.442336 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] creating volume 'volume-02cbc06b-9ea4-4656-a459-2ec9f65983a3' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:49:37.443688 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:37.617344 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:49:37.617731 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:49:37.620058 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69aa7712-7ebf-4a01-a4e0-7608c0b13112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02cbc06b-9ea4-4656-a459-2ec9f65983a3', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:49:37.622613 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11c1033-f3ff-48ef-9a67-f5c7cd395a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:49:37.650208 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Volume volume-02cbc06b-9ea4-4656-a459-2ec9f65983a3 (02cbc06b-9ea4-4656-a459-2ec9f65983a3): created successfully Dec 11 20:49:37.652838 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11c1033-f3ff-48ef-9a67-f5c7cd395a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:49:37.656649 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Flow 'volume_create_manager' (384ebb54-6134-4bba-adc6-48857eace767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:49:37.670433 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-68b770e5-e348-4a6d-99d9-f57be5cb8a32 tempest-AttachSCSIVolumeTestJSON-819908471 None] Created volume successfully. Dec 11 20:49:39.163554 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-8b691f99-ed79-4780-9913-a4192583ce4e req-4f3de302-643e-4177-96a3-28f5a486dc17 tempest-AttachSCSIVolumeTestJSON-819908471 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:49:40.659513 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-8b691f99-ed79-4780-9913-a4192583ce4e req-4f3de302-643e-4177-96a3-28f5a486dc17 tempest-AttachSCSIVolumeTestJSON-819908471 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.499s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:49:40.660238 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-8b691f99-ed79-4780-9913-a4192583ce4e req-4f3de302-643e-4177-96a3-28f5a486dc17 tempest-AttachSCSIVolumeTestJSON-819908471 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-02cbc06b-9ea4-4656-a459-2ec9f65983a3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '02cbc06b-9ea4-4656-a459-2ec9f65983a3', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:49:40.692528 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-8b691f99-ed79-4780-9913-a4192583ce4e req-4f3de302-643e-4177-96a3-28f5a486dc17 tempest-AttachSCSIVolumeTestJSON-819908471 None] Connection info returned from driver {'name': 'volumes/volume-02cbc06b-9ea4-4656-a459-2ec9f65983a3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '02cbc06b-9ea4-4656-a459-2ec9f65983a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '927f41ac-94e6-4c7c-a8b9-36a2bb8dd307'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:49:40.760989 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-8b691f99-ed79-4780-9913-a4192583ce4e req-4f3de302-643e-4177-96a3-28f5a486dc17 tempest-AttachSCSIVolumeTestJSON-819908471 None] attachment_update completed successfully. Dec 11 20:49:46.277626 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-c2cae16b-c208-4252-87e3-0bb634868e30 req-be7a61c2-9229-4790-9d22-d7aabbc82d17 tempest-AttachSCSIVolumeTestJSON-819908471 None] Terminate volume connection completed successfully. Dec 11 20:49:46.283356 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-c2cae16b-c208-4252-87e3-0bb634868e30 req-be7a61c2-9229-4790-9d22-d7aabbc82d17 tempest-AttachSCSIVolumeTestJSON-819908471 None] Deleting attachment 927f41ac-94e6-4c7c-a8b9-36a2bb8dd307. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 20:49:55.055998 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:49:55.057742 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:55.130165 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:55.190442 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:49:57.521927 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c9121cb8-f351-4310-8525-423b7cde0489 tempest-AttachSCSIVolumeTestJSON-819908471 None] Lock "b'cinder-02cbc06b-9ea4-4656-a459-2ec9f65983a3-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:49:57.592856 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c9121cb8-f351-4310-8525-423b7cde0489 tempest-AttachSCSIVolumeTestJSON-819908471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:57.695164 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c9121cb8-f351-4310-8525-423b7cde0489 tempest-AttachSCSIVolumeTestJSON-819908471 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 20:49:57.695638 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c9121cb8-f351-4310-8525-423b7cde0489 tempest-AttachSCSIVolumeTestJSON-819908471 None] Volume volume-02cbc06b-9ea4-4656-a459-2ec9f65983a3 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:49:57.712592 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c9121cb8-f351-4310-8525-423b7cde0489 tempest-AttachSCSIVolumeTestJSON-819908471 None] deleting rbd volume volume-02cbc06b-9ea4-4656-a459-2ec9f65983a3 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 20:49:58.111889 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-c9121cb8-f351-4310-8525-423b7cde0489 tempest-AttachSCSIVolumeTestJSON-819908471 None] Created reservations ['db22cb7a-015d-4826-b036-ec5b9581d076', 'd1f293f8-087e-4dbe-b859-cbc92bb45d27', '3f701522-fdd4-492d-92f7-d47239d2b15e', 'd721677c-c8f5-433f-9616-7bbb444cdca5'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 20:49:58.184594 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c9121cb8-f351-4310-8525-423b7cde0489 tempest-AttachSCSIVolumeTestJSON-819908471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:58.246721 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c9121cb8-f351-4310-8525-423b7cde0489 tempest-AttachSCSIVolumeTestJSON-819908471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:49:58.300138 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-c9121cb8-f351-4310-8525-423b7cde0489 tempest-AttachSCSIVolumeTestJSON-819908471 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:49:58.304599 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c9121cb8-f351-4310-8525-423b7cde0489 tempest-AttachSCSIVolumeTestJSON-819908471 None] Deleted volume successfully. Dec 11 20:49:58.325633 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c9121cb8-f351-4310-8525-423b7cde0489 tempest-AttachSCSIVolumeTestJSON-819908471 None] Lock "b'cinder-02cbc06b-9ea4-4656-a459-2ec9f65983a3-delete_volume'" released by "delete_volume" :: held 0.804s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:50:01.600240 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:50:01.613286 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:50:01.615065 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:50:01.639805 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Flow 'volume_create_manager' (1957f3ff-5263-4562-a943-a9c49a8a39a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:50:01.644942 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd34000b-2a17-42a9-9722-a0776c54a3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:50:01.653563 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:50:01.680167 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd34000b-2a17-42a9-9722-a0776c54a3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-928137378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0dd079d3-9d32-4641-aba0-15729e22fd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385463c536d74a2b9b8843b31636747e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:50:02Z,use_quota=True,user_id='51778d7f08424b8a83fd3a27c96ef2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:50:01.683136 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1f6463-865f-4686-8797-99c7a92a5be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:50:01.685540 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1f6463-865f-4686-8797-99c7a92a5be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:50:01.688292 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77986744-55cc-453c-a5b6-315249e89c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:50:01.690865 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77986744-55cc-453c-a5b6-315249e89c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd079d3-9d32-4641-aba0-15729e22fd77', 'volume_name': 'volume-0dd079d3-9d32-4641-aba0-15729e22fd77', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:50:01.693452 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c0da42-fad3-4fa1-987a-061fbe11b746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:50:01.696439 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c0da42-fad3-4fa1-987a-061fbe11b746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:50:01.698960 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bdbc11-4918-4d35-94f6-ed6163610fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:50:01.699961 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Volume 0dd079d3-9d32-4641-aba0-15729e22fd77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd079d3-9d32-4641-aba0-15729e22fd77', 'volume_size': 1} Dec 11 20:50:01.700553 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] creating volume 'volume-0dd079d3-9d32-4641-aba0-15729e22fd77' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:50:01.701798 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:50:01.886314 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:50:01.887416 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:50:01.890745 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bdbc11-4918-4d35-94f6-ed6163610fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd079d3-9d32-4641-aba0-15729e22fd77', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:50:01.894541 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21206fd1-50a3-4b2b-9d45-f4ac5396c111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:50:01.912047 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Volume volume-0dd079d3-9d32-4641-aba0-15729e22fd77 (0dd079d3-9d32-4641-aba0-15729e22fd77): created successfully Dec 11 20:50:01.917960 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21206fd1-50a3-4b2b-9d45-f4ac5396c111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:50:01.927791 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Flow 'volume_create_manager' (1957f3ff-5263-4562-a943-a9c49a8a39a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:50:01.949563 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-70990fe6-18ff-477b-8253-e54810a107a4 tempest-LiveMigrationTest-62741823 None] Created volume successfully. Dec 11 20:50:06.908095 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-27f9de75-533c-49da-a659-8ac35636b96a req-b2033940-bf89-42fd-b359-727f8723f2dd tempest-LiveMigrationTest-62741823 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:50:08.357074 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-27f9de75-533c-49da-a659-8ac35636b96a req-b2033940-bf89-42fd-b359-727f8723f2dd tempest-LiveMigrationTest-62741823 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.448s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:50:08.358017 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-27f9de75-533c-49da-a659-8ac35636b96a req-b2033940-bf89-42fd-b359-727f8723f2dd tempest-LiveMigrationTest-62741823 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0dd079d3-9d32-4641-aba0-15729e22fd77', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '0dd079d3-9d32-4641-aba0-15729e22fd77', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:50:08.386329 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-27f9de75-533c-49da-a659-8ac35636b96a req-b2033940-bf89-42fd-b359-727f8723f2dd tempest-LiveMigrationTest-62741823 None] Connection info returned from driver {'name': 'volumes/volume-0dd079d3-9d32-4641-aba0-15729e22fd77', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0dd079d3-9d32-4641-aba0-15729e22fd77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3111ea9e-27be-48aa-a2fc-e8104d0ef50e'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:50:08.470241 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-27f9de75-533c-49da-a659-8ac35636b96a req-b2033940-bf89-42fd-b359-727f8723f2dd tempest-LiveMigrationTest-62741823 None] attachment_update completed successfully. Dec 11 20:50:19.125656 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-0238458e-f508-423c-9264-8cfcba227e85 req-5510604a-992a-4c4b-8064-a1a8e93f574a tempest-LiveMigrationTest-811229424 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:50:20.493506 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-0238458e-f508-423c-9264-8cfcba227e85 req-5510604a-992a-4c4b-8064-a1a8e93f574a tempest-LiveMigrationTest-811229424 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.368s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:50:20.495123 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-0238458e-f508-423c-9264-8cfcba227e85 req-5510604a-992a-4c4b-8064-a1a8e93f574a tempest-LiveMigrationTest-811229424 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0dd079d3-9d32-4641-aba0-15729e22fd77', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '0dd079d3-9d32-4641-aba0-15729e22fd77', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:50:20.532733 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-0238458e-f508-423c-9264-8cfcba227e85 req-5510604a-992a-4c4b-8064-a1a8e93f574a tempest-LiveMigrationTest-811229424 None] Connection info returned from driver {'name': 'volumes/volume-0dd079d3-9d32-4641-aba0-15729e22fd77', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0dd079d3-9d32-4641-aba0-15729e22fd77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ba256738-02ca-4fb5-afb3-0d81f9e01146'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:50:20.644460 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-0238458e-f508-423c-9264-8cfcba227e85 req-5510604a-992a-4c4b-8064-a1a8e93f574a tempest-LiveMigrationTest-811229424 None] attachment_update completed successfully. Dec 11 20:50:35.921806 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-0238458e-f508-423c-9264-8cfcba227e85 req-53971b2b-d4c4-4952-80e7-51c4bf75d332 tempest-LiveMigrationTest-811229424 None] Terminate volume connection completed successfully. Dec 11 20:50:35.922449 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-0238458e-f508-423c-9264-8cfcba227e85 req-53971b2b-d4c4-4952-80e7-51c4bf75d332 tempest-LiveMigrationTest-811229424 None] Deleting attachment 3111ea9e-27be-48aa-a2fc-e8104d0ef50e. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 20:50:55.060158 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:50:55.061157 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:50:55.137324 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:50:55.201089 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:51:03.530648 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-b63f5ba0-ea0c-4f12-b54b-73b7993b5f7a req-429db885-cc4a-4e69-aef6-f0d485c678e3 tempest-LiveMigrationTest-62741823 None] Terminate volume connection completed successfully. Dec 11 20:51:03.531805 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-b63f5ba0-ea0c-4f12-b54b-73b7993b5f7a req-429db885-cc4a-4e69-aef6-f0d485c678e3 tempest-LiveMigrationTest-62741823 None] Deleting attachment ba256738-02ca-4fb5-afb3-0d81f9e01146. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 20:51:05.196553 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:51:05.203850 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:51:05.204571 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:51:05.227359 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Flow 'volume_create_manager' (9bc323b1-ca71-4d37-a0df-5db4764cd6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:51:05.231498 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4af6c0-2d52-4ffc-9927-9e7fc990e420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:51:05.239127 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:51:05.256500 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4af6c0-2d52-4ffc-9927-9e7fc990e420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-884177008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dc518867-b86b-43da-a7ed-f4805e120bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385463c536d74a2b9b8843b31636747e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:51:05Z,use_quota=True,user_id='51778d7f08424b8a83fd3a27c96ef2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:51:05.259369 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ced37c-d722-4eae-bf2b-5f3413f08ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:51:05.261770 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ced37c-d722-4eae-bf2b-5f3413f08ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:51:05.264438 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5d76ef-4513-4882-8e70-4e52b410c273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:51:05.374407 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5d76ef-4513-4882-8e70-4e52b410c273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc518867-b86b-43da-a7ed-f4805e120bdf', 'volume_name': 'volume-dc518867-b86b-43da-a7ed-f4805e120bdf', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:51:05.376951 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33578fd1-7156-4f9f-9715-607b3816aaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:51:05.379907 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33578fd1-7156-4f9f-9715-607b3816aaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:51:05.382132 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f280f400-0664-461f-878c-a33400afe804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:51:05.382996 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Volume dc518867-b86b-43da-a7ed-f4805e120bdf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc518867-b86b-43da-a7ed-f4805e120bdf', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 20:51:05.383611 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Cloning dc518867-b86b-43da-a7ed-f4805e120bdf from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 20:51:05.395678 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:51:05.405585 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Preparing cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:875}} Dec 11 20:51:05.406724 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 20:51:18.043297 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.image_utils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph, size 616.00 MB, duration 12.63 sec {{(pid=134173) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Dec 11 20:51:18.044348 ncdv-master-1 cinder-volume[134173]: INFO cinder.image.image_utils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Image download 616.00 MB at 48.77 MB/s Dec 11 20:51:18.083277 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:51:18.308838 ncdv-master-1 sudo[144871]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph Dec 11 20:51:18.312451 ncdv-master-1 sudo[144871]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 11 20:51:19.735717 ncdv-master-1 sudo[144871]: pam_unix(sudo:session): session closed for user root Dec 11 20:51:19.738606 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph" returned: 0 in 1.655s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:51:19.743174 ncdv-master-1 cinder-volume[134173]: WARNING py.warnings [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Dec 11 20:51:19.743174 ncdv-master-1 cinder-volume[134173]: debtcollector.deprecate( Dec 11 20:51:19.743174 ncdv-master-1 cinder-volume[134173]: Dec 11 20:51:19.743913 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.image_utils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Temporary image 659d8dfa-8ba1-483c-93c0-647553900999 is fetched for user 51778d7f08424b8a83fd3a27c96ef2a9. {{(pid=134173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Dec 11 20:51:20.102633 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:51:20.225362 ncdv-master-1 sudo[144886]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph Dec 11 20:51:20.226332 ncdv-master-1 sudo[144886]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 11 20:51:21.512289 ncdv-master-1 sudo[144886]: pam_unix(sudo:session): session closed for user root Dec 11 20:51:21.514744 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph" returned: 0 in 1.412s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:51:21.516315 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] creating volume 'volume-dc518867-b86b-43da-a7ed-f4805e120bdf' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:51:21.518116 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:51:21.689044 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:51:21.689489 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:51:21.722371 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Attempting download of 659d8dfa-8ba1-483c-93c0-647553900999 ((None, None)) to volume dc518867-b86b-43da-a7ed-f4805e120bdf. {{(pid=134173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1228}} Dec 11 20:51:21.843738 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_659d8dfa-8ba1-483c-93c0-647553900999_etn7enj9 {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:51:22.057921 ncdv-master-1 sudo[144924]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_659d8dfa-8ba1-483c-93c0-647553900999_etn7enj9 Dec 11 20:51:22.059248 ncdv-master-1 sudo[144924]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 11 20:51:22.885293 ncdv-master-1 sudo[144924]: pam_unix(sudo:session): session closed for user root Dec 11 20:51:22.887402 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_659d8dfa-8ba1-483c-93c0-647553900999_etn7enj9" returned: 0 in 1.043s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:51:22.890030 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:51:23.027147 ncdv-master-1 sudo[144932]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph Dec 11 20:51:23.031078 ncdv-master-1 sudo[144932]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 11 20:51:24.322137 ncdv-master-1 sudo[144932]: pam_unix(sudo:session): session closed for user root Dec 11 20:51:24.324831 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph" returned: 0 in 1.434s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:51:24.325685 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.image_utils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] 659d8dfa-8ba1-483c-93c0-647553900999 was vhdx, converting to raw {{(pid=134173) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Dec 11 20:51:24.327203 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpa4vf0416 {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:51:24.350676 ncdv-master-1 sudo[144947]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpa4vf0416 Dec 11 20:51:24.352354 ncdv-master-1 sudo[144947]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 11 20:51:26.129138 ncdv-master-1 sudo[144947]: pam_unix(sudo:session): session closed for user root Dec 11 20:51:26.133551 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpa4vf0416" returned: 0 in 1.804s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:51:26.133551 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:51:26.408670 ncdv-master-1 sudo[144961]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph Dec 11 20:51:26.409832 ncdv-master-1 sudo[144961]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 11 20:51:27.497387 ncdv-master-1 sudo[144961]: pam_unix(sudo:session): session closed for user root Dec 11 20:51:27.500032 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph" returned: 0 in 1.366s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:51:27.501311 ncdv-master-1 cinder-volume[134173]: WARNING py.warnings [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Dec 11 20:51:27.501311 ncdv-master-1 cinder-volume[134173]: debtcollector.deprecate( Dec 11 20:51:27.501311 ncdv-master-1 cinder-volume[134173]: Dec 11 20:51:27.506244 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.image_utils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_659d8dfa-8ba1-483c-93c0-647553900999_yg25ykglncdv-master-1@ceph, size 700.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/conversion/tmpa4vf0416 {{(pid=134173) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Dec 11 20:51:27.507392 ncdv-master-1 cinder-volume[134173]: INFO cinder.image.image_utils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Converted 700.00 MB image at 387.57 MB/s Dec 11 20:51:27.509354 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:51:27.634516 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 20:51:27.635238 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:51:27.654426 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] deleting rbd volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 20:51:28.109148 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpa4vf0416 volume-dc518867-b86b-43da-a7ed-f4805e120bdf --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:51:36.113595 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpa4vf0416 volume-dc518867-b86b-43da-a7ed-f4805e120bdf --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 8.004s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:51:36.257267 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:51:36.455752 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:51:36.456141 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:51:36.456594 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Downloaded image 659d8dfa-8ba1-483c-93c0-647553900999 ((None, None)) to volume dc518867-b86b-43da-a7ed-f4805e120bdf successfully. {{(pid=134173) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1268}} Dec 11 20:51:36.554107 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.image_utils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Temporary image 659d8dfa-8ba1-483c-93c0-647553900999 for user 51778d7f08424b8a83fd3a27c96ef2a9 is deleted. {{(pid=134173) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Dec 11 20:51:36.769141 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Created reservations ['bdbf40f9-e3e5-472f-b488-95287b153005', '5a6c1442-cca0-4ab3-ba1f-53a15df86069', 'ec0365c2-9526-419b-a15b-5b354a92480d', '7cfab17b-c172-4a65-9add-1e2adba513cf'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 20:51:36.787316 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Creating image volume entry: {'replication_extended_status': None, 'display_description': None, 'display_name': 'image-659d8dfa-8ba1-483c-93c0-647553900999', 'group_id': None, 'ec2_id': None, 'scheduled_at': datetime.datetime(2021, 12, 11, 20, 51, 5, tzinfo=datetime.timezone.utc), 'service_uuid': None, 'terminated_at': None, 'project_id': '0fa26583c3854499bf9a64bce9b104c1', 'provider_auth': None, 'provider_location': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'launched_at': None, 'deleted_at': None, 'provider_id': None, 'size': 1, 'replication_driver_data': None, 'user_id': '51778d7f08424b8a83fd3a27c96ef2a9', 'volume_admin_metadata': [], 'created_at': datetime.datetime(2021, 12, 11, 20, 51, 5, tzinfo=datetime.timezone.utc), 'deleted': False, 'metadata': {}, 'consistencygroup_id': None, 'shared_targets': True, 'previous_status': None, 'replication_status': None, 'availability_zone': 'nova', 'provider_geometry': None, 'volume_type_id': '5aaae771-290d-40aa-8e6c-3fda92dceecd', 'updated_at': datetime.datetime(2021, 12, 11, 20, 51, 5, tzinfo=datetime.timezone.utc), 'bootable': False, 'multiattach': False, 'host': 'ncdv-master-1@ceph#ceph', 'cluster_name': None, 'encryption_key_id': None, 'volume_metadata': [], 'attach_status': 'detached', 'status': 'creating', 'source_volid': 'dc518867-b86b-43da-a7ed-f4805e120bdf'}. {{(pid=134173) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} Dec 11 20:51:36.909866 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Volume reschedule parameters: False retry: None {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:51:36.915112 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:51:36.915885 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:51:36.933153 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Flow 'volume_create_manager' (65812415-dcbc-44e7-b7d2-65bae178abc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:51:36.939051 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637cee6f-1737-4588-b933-6c1c56dd0c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:51:36.947059 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:51:36.964889 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637cee6f-1737-4588-b933-6c1c56dd0c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='image-659d8dfa-8ba1-483c-93c0-647553900999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=77b5072a-b5ee-4761-8a94-97ee1dfb3e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa26583c3854499bf9a64bce9b104c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dc518867-b86b-43da-a7ed-f4805e120bdf,status='creating',terminated_at=None,updated_at=2021-12-11T20:51:05Z,use_quota=True,user_id='51778d7f08424b8a83fd3a27c96ef2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:51:36.970629 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6761bf99-6fe2-44e4-866c-289dd7045923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:51:36.973715 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6761bf99-6fe2-44e4-866c-289dd7045923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:51:36.980772 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb884f7-d1d4-4a9f-9dd4-6daaa8778918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:51:37.023967 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb884f7-d1d4-4a9f-9dd4-6daaa8778918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'volume_name': 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'volume_size': 1, 'source_volid': 'dc518867-b86b-43da-a7ed-f4805e120bdf', 'source_volstatus': 'downloading'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:51:37.034944 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839fa2a7-a852-46a9-a39b-e41cafc819c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:51:37.037999 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839fa2a7-a852-46a9-a39b-e41cafc819c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:51:37.045285 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3635aab8-c82e-4304-ae5e-56f0715861c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:51:37.049788 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'volume_size': 1, 'source_volid': 'dc518867-b86b-43da-a7ed-f4805e120bdf', 'source_volstatus': 'downloading'} Dec 11 20:51:37.090728 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:51:37.179528 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] creating snapshot='volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 20:51:37.541996 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] cloning 'volume-dc518867-b86b-43da-a7ed-f4805e120bdf@volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78.clone_snap' to 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 20:51:37.695119 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:51:37.696231 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:51:37.696706 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:51:37.739308 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 20:51:37.741760 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3635aab8-c82e-4304-ae5e-56f0715861c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'volume_size': 1, 'source_volid': 'dc518867-b86b-43da-a7ed-f4805e120bdf', 'source_volstatus': 'downloading'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:51:37.745291 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecd08f0-e8a5-4404-81bd-c6ffd39e7563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:51:37.764838 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Volume volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78 (77b5072a-b5ee-4761-8a94-97ee1dfb3e78): created successfully Dec 11 20:51:37.769653 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecd08f0-e8a5-4404-81bd-c6ffd39e7563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:51:37.774323 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Flow 'volume_create_manager' (65812415-dcbc-44e7-b7d2-65bae178abc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:51:37.790010 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Created volume successfully. Dec 11 20:51:37.880563 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Creating new image-volume cache entry for image 659d8dfa-8ba1-483c-93c0-647553900999 on ncdv-master-1@ceph#ceph {{(pid=134173) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Dec 11 20:51:37.905553 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] New image-volume cache entry created: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 20, 51, 37, 885069)}. {{(pid=134173) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Dec 11 20:51:37.917136 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 32.520s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:51:37.919942 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Marking volume dc518867-b86b-43da-a7ed-f4805e120bdf as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 20:51:37.940932 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to dc518867-b86b-43da-a7ed-f4805e120bdf. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 20:51:37.941796 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Creating volume glance metadata for volume dc518867-b86b-43da-a7ed-f4805e120bdf backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 20:51:38.077082 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f280f400-0664-461f-878c-a33400afe804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc518867-b86b-43da-a7ed-f4805e120bdf', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:51:38.079711 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2966ae-3169-4fc0-9e84-1a291cadcd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:51:38.101965 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf (dc518867-b86b-43da-a7ed-f4805e120bdf): created successfully Dec 11 20:51:38.104258 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2966ae-3169-4fc0-9e84-1a291cadcd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:51:38.111898 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Flow 'volume_create_manager' (9bc323b1-ca71-4d37-a0df-5db4764cd6ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:51:38.130366 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ca5d290e-fa73-47f8-9c65-223503cb8e79 tempest-LiveMigrationTest-62741823 None] Created volume successfully. Dec 11 20:51:45.500496 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-0ef97bb2-ea43-4dc6-9409-ef9b7f053201 req-ad99f0ac-e04d-4ac8-9870-7fdac15089e3 tempest-LiveMigrationTest-62741823 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:51:46.956568 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-0ef97bb2-ea43-4dc6-9409-ef9b7f053201 req-ad99f0ac-e04d-4ac8-9870-7fdac15089e3 tempest-LiveMigrationTest-62741823 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.456s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:51:46.957538 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-0ef97bb2-ea43-4dc6-9409-ef9b7f053201 req-ad99f0ac-e04d-4ac8-9870-7fdac15089e3 tempest-LiveMigrationTest-62741823 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dc518867-b86b-43da-a7ed-f4805e120bdf', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'dc518867-b86b-43da-a7ed-f4805e120bdf', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:51:47.012749 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-0ef97bb2-ea43-4dc6-9409-ef9b7f053201 req-ad99f0ac-e04d-4ac8-9870-7fdac15089e3 tempest-LiveMigrationTest-62741823 None] Connection info returned from driver {'name': 'volumes/volume-dc518867-b86b-43da-a7ed-f4805e120bdf', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dc518867-b86b-43da-a7ed-f4805e120bdf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0ddc4a2b-df94-445a-a6c9-3ee58d09892e'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:51:47.187491 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-0ef97bb2-ea43-4dc6-9409-ef9b7f053201 req-ad99f0ac-e04d-4ac8-9870-7fdac15089e3 tempest-LiveMigrationTest-62741823 None] attachment_update completed successfully. Dec 11 20:51:55.057382 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:51:55.058691 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:51:55.131163 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:51:55.225102 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:52:08.403115 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-4775499c-4275-4b29-ae9e-ed8ff9934a3c req-27b8f13d-d212-4011-ac9d-a963690c47cd tempest-LiveMigrationTest-811229424 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:52:09.534291 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-4775499c-4275-4b29-ae9e-ed8ff9934a3c req-27b8f13d-d212-4011-ac9d-a963690c47cd tempest-LiveMigrationTest-811229424 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.131s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:52:09.535108 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-4775499c-4275-4b29-ae9e-ed8ff9934a3c req-27b8f13d-d212-4011-ac9d-a963690c47cd tempest-LiveMigrationTest-811229424 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dc518867-b86b-43da-a7ed-f4805e120bdf', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'dc518867-b86b-43da-a7ed-f4805e120bdf', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:52:09.569458 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-4775499c-4275-4b29-ae9e-ed8ff9934a3c req-27b8f13d-d212-4011-ac9d-a963690c47cd tempest-LiveMigrationTest-811229424 None] Connection info returned from driver {'name': 'volumes/volume-dc518867-b86b-43da-a7ed-f4805e120bdf', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dc518867-b86b-43da-a7ed-f4805e120bdf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a65b8703-46ff-4272-bc72-a2019be7c41b'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:52:09.847967 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-4775499c-4275-4b29-ae9e-ed8ff9934a3c req-27b8f13d-d212-4011-ac9d-a963690c47cd tempest-LiveMigrationTest-811229424 None] attachment_update completed successfully. Dec 11 20:52:18.059766 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-4775499c-4275-4b29-ae9e-ed8ff9934a3c req-f4e408e7-b09d-44e7-888d-63595aa7f40c tempest-LiveMigrationTest-811229424 None] Terminate volume connection completed successfully. Dec 11 20:52:18.061058 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-4775499c-4275-4b29-ae9e-ed8ff9934a3c req-f4e408e7-b09d-44e7-888d-63595aa7f40c tempest-LiveMigrationTest-811229424 None] Deleting attachment 0ddc4a2b-df94-445a-a6c9-3ee58d09892e. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 20:52:28.889605 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-d21a8572-54fc-4d93-b172-855d42eb1527 tempest-LiveMigrationTest-62741823 None] Terminate volume connection completed successfully. Dec 11 20:52:28.890186 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-d21a8572-54fc-4d93-b172-855d42eb1527 tempest-LiveMigrationTest-62741823 None] Deleting attachment a65b8703-46ff-4272-bc72-a2019be7c41b. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 20:52:29.061160 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-b592ce28-936b-422c-b294-5032079fcca1 tempest-LiveMigrationTest-62741823 None] Lock "b'cinder-dc518867-b86b-43da-a7ed-f4805e120bdf-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:52:29.111227 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-b592ce28-936b-422c-b294-5032079fcca1 tempest-LiveMigrationTest-62741823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:52:29.205390 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-b592ce28-936b-422c-b294-5032079fcca1 tempest-LiveMigrationTest-62741823 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 20:52:29.206099 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-b592ce28-936b-422c-b294-5032079fcca1 tempest-LiveMigrationTest-62741823 None] volume has clone snapshot(s) {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1208}} Dec 11 20:52:29.209640 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-b592ce28-936b-422c-b294-5032079fcca1 tempest-LiveMigrationTest-62741823 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:52:29.365027 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-b592ce28-936b-422c-b294-5032079fcca1 tempest-LiveMigrationTest-62741823 None] Created reservations ['27992d45-fe36-4d32-a8af-2178ad3d93bd', '27c6f6a1-51f6-46c7-a47e-3140f55c7a56', '17828e6e-642f-49cf-8561-f82d49ebaa9c', '56677e32-bf75-4773-b750-e4f70e91df3d'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 20:52:29.449364 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-b592ce28-936b-422c-b294-5032079fcca1 tempest-LiveMigrationTest-62741823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:52:29.543649 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-b592ce28-936b-422c-b294-5032079fcca1 tempest-LiveMigrationTest-62741823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:52:29.612834 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-b592ce28-936b-422c-b294-5032079fcca1 tempest-LiveMigrationTest-62741823 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:52:29.630013 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-b592ce28-936b-422c-b294-5032079fcca1 tempest-LiveMigrationTest-62741823 None] Deleted volume successfully. Dec 11 20:52:29.660952 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-ef9fd12e-71fb-4232-a8aa-2441446def33 req-b592ce28-936b-422c-b294-5032079fcca1 tempest-LiveMigrationTest-62741823 None] Lock "b'cinder-dc518867-b86b-43da-a7ed-f4805e120bdf-delete_volume'" released by "delete_volume" :: held 0.600s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:52:30.038586 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-e4bf8f32-8e8b-4d9d-8b89-b750cd2a2b99 tempest-LiveMigrationTest-62741823 None] Lock "b'cinder-0dd079d3-9d32-4641-aba0-15729e22fd77-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:52:30.101431 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e4bf8f32-8e8b-4d9d-8b89-b750cd2a2b99 tempest-LiveMigrationTest-62741823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:52:30.162702 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e4bf8f32-8e8b-4d9d-8b89-b750cd2a2b99 tempest-LiveMigrationTest-62741823 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 20:52:30.163201 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e4bf8f32-8e8b-4d9d-8b89-b750cd2a2b99 tempest-LiveMigrationTest-62741823 None] Volume volume-0dd079d3-9d32-4641-aba0-15729e22fd77 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:52:30.174158 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e4bf8f32-8e8b-4d9d-8b89-b750cd2a2b99 tempest-LiveMigrationTest-62741823 None] deleting rbd volume volume-0dd079d3-9d32-4641-aba0-15729e22fd77 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 20:52:30.603226 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-e4bf8f32-8e8b-4d9d-8b89-b750cd2a2b99 tempest-LiveMigrationTest-62741823 None] Created reservations ['d304fe57-38a7-444f-8b61-e47c570caad2', 'f8b4fa06-32dd-4b01-a7dc-1edd01afd93c', '4f77c5a6-802e-4062-9d8d-660debd74805', '676aa905-ed96-43a3-bbff-85794e82991a'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 20:52:30.749480 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e4bf8f32-8e8b-4d9d-8b89-b750cd2a2b99 tempest-LiveMigrationTest-62741823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:52:30.820844 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e4bf8f32-8e8b-4d9d-8b89-b750cd2a2b99 tempest-LiveMigrationTest-62741823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:52:30.899039 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-e4bf8f32-8e8b-4d9d-8b89-b750cd2a2b99 tempest-LiveMigrationTest-62741823 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:52:30.904552 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-e4bf8f32-8e8b-4d9d-8b89-b750cd2a2b99 tempest-LiveMigrationTest-62741823 None] Deleted volume successfully. Dec 11 20:52:30.939550 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-e4bf8f32-8e8b-4d9d-8b89-b750cd2a2b99 tempest-LiveMigrationTest-62741823 None] Lock "b'cinder-0dd079d3-9d32-4641-aba0-15729e22fd77-delete_volume'" released by "delete_volume" :: held 0.901s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:52:55.061778 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:52:55.062626 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:52:55.162705 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:52:55.230452 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:53:55.064791 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:53:55.065607 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:53:55.161398 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:53:55.234385 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:54:55.060464 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:54:55.062056 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:54:55.133176 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:54:55.201005 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:55:00.722863 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:55:00.735426 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:55:00.736628 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:55:00.774957 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Flow 'volume_create_manager' (cc7cf1ee-bbd3-4003-96bd-999ef34a4644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:55:00.782162 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2540eb-97fd-44bf-9f2b-256962264a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:00.798269 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:55:00.824943 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2540eb-97fd-44bf-9f2b-256962264a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1125501377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a2771b04-1309-441b-b6e9-2c6b44964ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9369187dfe604d4a835b84f4063ce5d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:55:01Z,use_quota=True,user_id='b18736b0bf014fa0b4c21400f9c0bab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:00.829655 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7b6957-0881-4d8a-90af-a0a5ce1a29d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:00.832460 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7b6957-0881-4d8a-90af-a0a5ce1a29d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:00.835877 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168bc58d-b5a2-4eb0-9a31-9fa91fcd367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:00.963153 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168bc58d-b5a2-4eb0-9a31-9fa91fcd367e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a2771b04-1309-441b-b6e9-2c6b44964ee1', 'volume_name': 'volume-a2771b04-1309-441b-b6e9-2c6b44964ee1', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:00.968275 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aceb13ea-5557-442e-8a0b-1e2a952a9115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:00.970725 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aceb13ea-5557-442e-8a0b-1e2a952a9115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:00.974424 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f6f5aa-e02a-4d30-9331-06237c85a6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:00.975537 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Volume a2771b04-1309-441b-b6e9-2c6b44964ee1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a2771b04-1309-441b-b6e9-2c6b44964ee1', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 20:55:00.976312 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Cloning a2771b04-1309-441b-b6e9-2c6b44964ee1 from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 20:55:00.988369 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:55:01.001514 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 20, 55, 0, 992937)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 20:55:01.003291 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 20:55:01.003983 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 20:55:01.010168 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:55:01.014263 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 20:55:01.027382 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 20, 55, 1, 22940)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 20:55:01.028567 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 20:55:01.029375 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 20:55:01.051484 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:55:01.196484 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] creating snapshot='volume-a2771b04-1309-441b-b6e9-2c6b44964ee1.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 20:55:01.845383 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-a2771b04-1309-441b-b6e9-2c6b44964ee1.clone_snap' to 'volume-a2771b04-1309-441b-b6e9-2c6b44964ee1' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 20:55:02.058584 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:55:02.060998 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:55:02.061935 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:55:02.109521 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 20:55:02.110189 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Marking volume a2771b04-1309-441b-b6e9-2c6b44964ee1 as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 20:55:02.120535 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to a2771b04-1309-441b-b6e9-2c6b44964ee1. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 20:55:02.121391 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Creating volume glance metadata for volume a2771b04-1309-441b-b6e9-2c6b44964ee1 backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 20:55:02.221173 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f6f5aa-e02a-4d30-9331-06237c85a6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2771b04-1309-441b-b6e9-2c6b44964ee1', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:02.223979 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575eae16-70b5-4691-92a3-3955be8e4dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:02.240423 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Volume volume-a2771b04-1309-441b-b6e9-2c6b44964ee1 (a2771b04-1309-441b-b6e9-2c6b44964ee1): created successfully Dec 11 20:55:02.242934 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575eae16-70b5-4691-92a3-3955be8e4dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:02.247045 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Flow 'volume_create_manager' (cc7cf1ee-bbd3-4003-96bd-999ef34a4644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:55:02.266241 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c486ace6-f75c-468c-b78a-1c99ef587fec tempest-TaggedBootDevicesTest-262552579 None] Created volume successfully. Dec 11 20:55:03.505984 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:55:03.517538 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:55:03.525022 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:55:03.560630 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Flow 'volume_create_manager' (a071624b-6335-4fde-82c1-3e3aaa6706b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:55:03.576685 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796384d7-7928-4b0d-937f-a5fe0678d682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:03.593448 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:55:03.615932 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796384d7-7928-4b0d-937f-a5fe0678d682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-66488348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1dfe182-bb86-46fb-a3e2-803cc6c4178f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9369187dfe604d4a835b84f4063ce5d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:55:03Z,use_quota=True,user_id='b18736b0bf014fa0b4c21400f9c0bab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:03.620394 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53776e61-4e9e-4b09-8bab-55972b835f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:03.624148 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53776e61-4e9e-4b09-8bab-55972b835f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:03.627721 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7145ecca-cb9d-4e93-b762-89fba5e112fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:03.631645 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7145ecca-cb9d-4e93-b762-89fba5e112fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1dfe182-bb86-46fb-a3e2-803cc6c4178f', 'volume_name': 'volume-c1dfe182-bb86-46fb-a3e2-803cc6c4178f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:03.640976 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8da7f78-73e8-45ef-bc1a-8225d8df6a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:03.644551 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8da7f78-73e8-45ef-bc1a-8225d8df6a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:03.648069 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d5a4e4-157b-495e-a465-56b0d7f1c263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:03.649325 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Volume c1dfe182-bb86-46fb-a3e2-803cc6c4178f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1dfe182-bb86-46fb-a3e2-803cc6c4178f', 'volume_size': 1} Dec 11 20:55:03.650398 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] creating volume 'volume-c1dfe182-bb86-46fb-a3e2-803cc6c4178f' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:55:03.651757 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:55:03.839745 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:55:03.840317 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:55:03.845439 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d5a4e4-157b-495e-a465-56b0d7f1c263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1dfe182-bb86-46fb-a3e2-803cc6c4178f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:03.848218 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2e29ce-0f98-436a-8f2b-6939fd6ead04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:03.867301 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Volume volume-c1dfe182-bb86-46fb-a3e2-803cc6c4178f (c1dfe182-bb86-46fb-a3e2-803cc6c4178f): created successfully Dec 11 20:55:03.874687 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2e29ce-0f98-436a-8f2b-6939fd6ead04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:03.886282 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Flow 'volume_create_manager' (a071624b-6335-4fde-82c1-3e3aaa6706b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:55:03.915849 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-dc9eb358-3643-4fb0-83ff-db6ce3e94a08 tempest-TaggedBootDevicesTest-262552579 None] Created volume successfully. Dec 11 20:55:05.237408 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:55:05.248471 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:55:05.249077 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:55:05.293095 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Flow 'volume_create_manager' (893ce8ac-2542-478c-8810-7059235967ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:55:05.303430 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffb052a-f578-4251-8f8b-2653fb1ac34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:05.319079 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:55:05.354990 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffb052a-f578-4251-8f8b-2653fb1ac34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1327930507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=063ad756-f8f1-422c-8ef8-c139a6abdaf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9369187dfe604d4a835b84f4063ce5d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:55:05Z,use_quota=True,user_id='b18736b0bf014fa0b4c21400f9c0bab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:05.358954 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a5d513-ea8a-44fd-8f9e-f2c24f63d1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:05.362629 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a5d513-ea8a-44fd-8f9e-f2c24f63d1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:05.366150 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb3fd7f-2bbd-4c78-bfcb-78fed214f443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:05.369649 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb3fd7f-2bbd-4c78-bfcb-78fed214f443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '063ad756-f8f1-422c-8ef8-c139a6abdaf5', 'volume_name': 'volume-063ad756-f8f1-422c-8ef8-c139a6abdaf5', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:05.374692 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4650bf35-5bd4-4d84-9619-1c0b9866adc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:05.378968 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4650bf35-5bd4-4d84-9619-1c0b9866adc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:05.381774 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c435f5-2a19-44fd-8811-4a5e4d0cd868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:05.383353 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Volume 063ad756-f8f1-422c-8ef8-c139a6abdaf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-063ad756-f8f1-422c-8ef8-c139a6abdaf5', 'volume_size': 1} Dec 11 20:55:05.383981 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] creating volume 'volume-063ad756-f8f1-422c-8ef8-c139a6abdaf5' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:55:05.385428 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:55:05.535902 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:55:05.536287 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:55:05.538940 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c435f5-2a19-44fd-8811-4a5e4d0cd868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063ad756-f8f1-422c-8ef8-c139a6abdaf5', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:05.541658 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c4ea2d-ec54-44a7-b2a3-b42e1b785467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:55:05.560852 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Volume volume-063ad756-f8f1-422c-8ef8-c139a6abdaf5 (063ad756-f8f1-422c-8ef8-c139a6abdaf5): created successfully Dec 11 20:55:05.563651 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c4ea2d-ec54-44a7-b2a3-b42e1b785467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:55:05.571067 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Flow 'volume_create_manager' (893ce8ac-2542-478c-8810-7059235967ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:55:05.592437 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1de59102-e6c7-4b17-a887-4ff1a98245fc tempest-TaggedBootDevicesTest-262552579 None] Created volume successfully. Dec 11 20:55:26.903930 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-be0394d3-5efe-4835-a2ce-a68a3029eb3e tempest-TaggedBootDevicesTest-262552579 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:55:27.805417 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-be0394d3-5efe-4835-a2ce-a68a3029eb3e tempest-TaggedBootDevicesTest-262552579 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.901s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:55:27.806194 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-be0394d3-5efe-4835-a2ce-a68a3029eb3e tempest-TaggedBootDevicesTest-262552579 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a2771b04-1309-441b-b6e9-2c6b44964ee1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'a2771b04-1309-441b-b6e9-2c6b44964ee1', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:55:27.874446 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-be0394d3-5efe-4835-a2ce-a68a3029eb3e tempest-TaggedBootDevicesTest-262552579 None] Connection info returned from driver {'name': 'volumes/volume-a2771b04-1309-441b-b6e9-2c6b44964ee1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a2771b04-1309-441b-b6e9-2c6b44964ee1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8360860a-5547-4187-ad32-9204ba15d12b'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:55:27.990962 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-be0394d3-5efe-4835-a2ce-a68a3029eb3e tempest-TaggedBootDevicesTest-262552579 None] attachment_update completed successfully. Dec 11 20:55:28.431892 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-8b6975ca-093f-4a42-a2d0-d968801351da tempest-TaggedBootDevicesTest-262552579 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:55:29.408793 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-8b6975ca-093f-4a42-a2d0-d968801351da tempest-TaggedBootDevicesTest-262552579 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.977s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:55:29.410426 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-8b6975ca-093f-4a42-a2d0-d968801351da tempest-TaggedBootDevicesTest-262552579 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c1dfe182-bb86-46fb-a3e2-803cc6c4178f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'c1dfe182-bb86-46fb-a3e2-803cc6c4178f', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:55:29.446809 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-8b6975ca-093f-4a42-a2d0-d968801351da tempest-TaggedBootDevicesTest-262552579 None] Connection info returned from driver {'name': 'volumes/volume-c1dfe182-bb86-46fb-a3e2-803cc6c4178f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c1dfe182-bb86-46fb-a3e2-803cc6c4178f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '570d3517-3d9f-4e59-a903-44b992c61c46'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:55:29.571633 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-8b6975ca-093f-4a42-a2d0-d968801351da tempest-TaggedBootDevicesTest-262552579 None] attachment_update completed successfully. Dec 11 20:55:29.922724 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-8004e1f9-af59-47b2-8f38-e0df51d77f42 tempest-TaggedBootDevicesTest-262552579 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:55:30.696355 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-8004e1f9-af59-47b2-8f38-e0df51d77f42 tempest-TaggedBootDevicesTest-262552579 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.773s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:55:30.697080 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-8004e1f9-af59-47b2-8f38-e0df51d77f42 tempest-TaggedBootDevicesTest-262552579 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-063ad756-f8f1-422c-8ef8-c139a6abdaf5', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '063ad756-f8f1-422c-8ef8-c139a6abdaf5', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:55:30.721702 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-8004e1f9-af59-47b2-8f38-e0df51d77f42 tempest-TaggedBootDevicesTest-262552579 None] Connection info returned from driver {'name': 'volumes/volume-063ad756-f8f1-422c-8ef8-c139a6abdaf5', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '063ad756-f8f1-422c-8ef8-c139a6abdaf5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'caac856b-6437-4c56-a290-502005821828'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:55:30.772705 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-59e3cbaf-3669-499b-9fc9-ad0917a84445 req-8004e1f9-af59-47b2-8f38-e0df51d77f42 tempest-TaggedBootDevicesTest-262552579 None] attachment_update completed successfully. Dec 11 20:55:55.057443 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:55:55.059190 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:55:55.168653 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:55:55.236335 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:56:00.550070 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:56:00.555826 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:56:00.576475 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:56:00.626697 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Flow 'volume_create_manager' (a420c46a-0b52-4f22-aaf6-a17b9c13eacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:56:00.641792 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a951f58c-5f12-458a-b9dc-7b0e313fcbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:00.655341 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:56:00.687085 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a951f58c-5f12-458a-b9dc-7b0e313fcbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-1031515140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e515830a-7134-4859-a11a-6f2e811d1996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf310bd024341a09265e9c0cf0a61cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:56:00Z,use_quota=True,user_id='33256b4f50d24bdfbc1761b88b5c9189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:00.696008 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d689aea-9aa5-4c71-a3bb-f3a183704f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:00.701569 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d689aea-9aa5-4c71-a3bb-f3a183704f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:00.711248 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb8f3ab-d564-44eb-9ed8-257b349d1fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:00.721251 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb8f3ab-d564-44eb-9ed8-257b349d1fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e515830a-7134-4859-a11a-6f2e811d1996', 'volume_name': 'volume-e515830a-7134-4859-a11a-6f2e811d1996', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:00.726657 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325119c8-618f-4fe6-be75-2fe5163ce2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:00.734240 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325119c8-618f-4fe6-be75-2fe5163ce2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:00.741231 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55300b6-33b0-43a5-afc6-59bdda30ee42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:00.742203 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Volume e515830a-7134-4859-a11a-6f2e811d1996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e515830a-7134-4859-a11a-6f2e811d1996', 'volume_size': 1} Dec 11 20:56:00.744964 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] creating volume 'volume-e515830a-7134-4859-a11a-6f2e811d1996' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:56:00.746521 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:56:00.875032 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:56:00.875323 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:56:00.877599 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55300b6-33b0-43a5-afc6-59bdda30ee42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e515830a-7134-4859-a11a-6f2e811d1996', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:00.880078 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a6ccce-81c0-404c-b6a3-18eddaa3b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:00.890446 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Volume volume-e515830a-7134-4859-a11a-6f2e811d1996 (e515830a-7134-4859-a11a-6f2e811d1996): created successfully Dec 11 20:56:00.894161 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a6ccce-81c0-404c-b6a3-18eddaa3b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:00.899301 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Flow 'volume_create_manager' (a420c46a-0b52-4f22-aaf6-a17b9c13eacc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:56:00.913391 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-fbd7997b-143c-417f-b4b5-393e87cf263e tempest-LiveAutoBlockMigrationV225Test-197978676 None] Created volume successfully. Dec 11 20:56:02.375620 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-5a4b0453-fbee-452f-8b6e-48da860d9cbe req-f9ebe97c-68f4-4006-bf48-7c708ee93c3f tempest-LiveAutoBlockMigrationV225Test-197978676 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:56:03.960372 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-5a4b0453-fbee-452f-8b6e-48da860d9cbe req-f9ebe97c-68f4-4006-bf48-7c708ee93c3f tempest-LiveAutoBlockMigrationV225Test-197978676 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.592s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:56:03.961353 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-5a4b0453-fbee-452f-8b6e-48da860d9cbe req-f9ebe97c-68f4-4006-bf48-7c708ee93c3f tempest-LiveAutoBlockMigrationV225Test-197978676 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e515830a-7134-4859-a11a-6f2e811d1996', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'e515830a-7134-4859-a11a-6f2e811d1996', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:56:03.998290 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-5a4b0453-fbee-452f-8b6e-48da860d9cbe req-f9ebe97c-68f4-4006-bf48-7c708ee93c3f tempest-LiveAutoBlockMigrationV225Test-197978676 None] Connection info returned from driver {'name': 'volumes/volume-e515830a-7134-4859-a11a-6f2e811d1996', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e515830a-7134-4859-a11a-6f2e811d1996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ea270f2a-1169-4042-a165-0afdf2ba3ddf'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:56:04.071880 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-5a4b0453-fbee-452f-8b6e-48da860d9cbe req-f9ebe97c-68f4-4006-bf48-7c708ee93c3f tempest-LiveAutoBlockMigrationV225Test-197978676 None] attachment_update completed successfully. Dec 11 20:56:12.169721 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-0b488512-249f-416b-b39d-69eb7806d047 req-b5a33cd1-c5ab-449f-acd4-7100b8278834 tempest-LiveAutoBlockMigrationV225Test-1350911859 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:56:13.152197 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-0b488512-249f-416b-b39d-69eb7806d047 req-b5a33cd1-c5ab-449f-acd4-7100b8278834 tempest-LiveAutoBlockMigrationV225Test-1350911859 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.982s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:56:13.153124 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-0b488512-249f-416b-b39d-69eb7806d047 req-b5a33cd1-c5ab-449f-acd4-7100b8278834 tempest-LiveAutoBlockMigrationV225Test-1350911859 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e515830a-7134-4859-a11a-6f2e811d1996', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'e515830a-7134-4859-a11a-6f2e811d1996', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:56:13.188094 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-0b488512-249f-416b-b39d-69eb7806d047 req-b5a33cd1-c5ab-449f-acd4-7100b8278834 tempest-LiveAutoBlockMigrationV225Test-1350911859 None] Connection info returned from driver {'name': 'volumes/volume-e515830a-7134-4859-a11a-6f2e811d1996', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e515830a-7134-4859-a11a-6f2e811d1996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1f3a9c29-e2e2-4fe9-ae36-90c3e8440332'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:56:13.276758 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-0b488512-249f-416b-b39d-69eb7806d047 req-b5a33cd1-c5ab-449f-acd4-7100b8278834 tempest-LiveAutoBlockMigrationV225Test-1350911859 None] attachment_update completed successfully. Dec 11 20:56:25.497140 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:56:25.512243 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:56:25.512751 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:56:25.543416 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Flow 'volume_create_manager' (79d70518-8926-44e5-81e7-b09e9347de5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:56:25.550468 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9638c93-9cde-4bf5-911a-db063d924d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:25.572554 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:56:25.605380 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9638c93-9cde-4bf5-911a-db063d924d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2753849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f8896d9b-d453-458b-9137-4b5e37666eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c90b7fcfb224a9c8a763b229c09b4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:56:25Z,use_quota=True,user_id='d73b3e9cb4ea483b829bc830afe6329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:25.612616 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d3b051-dbb5-492e-96ff-b7dadf5acd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:25.615027 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d3b051-dbb5-492e-96ff-b7dadf5acd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:25.624737 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e42b0d4-46c5-45dd-82f1-399c04c6d25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:25.633960 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e42b0d4-46c5-45dd-82f1-399c04c6d25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8896d9b-d453-458b-9137-4b5e37666eb4', 'volume_name': 'volume-f8896d9b-d453-458b-9137-4b5e37666eb4', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:25.636799 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c64e2b-01ef-409c-96c7-9631d34f013f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:25.639370 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c64e2b-01ef-409c-96c7-9631d34f013f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:25.645377 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8289e07f-9794-493b-bbfd-61c6f6162e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:25.649395 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Volume f8896d9b-d453-458b-9137-4b5e37666eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8896d9b-d453-458b-9137-4b5e37666eb4', 'volume_size': 1} Dec 11 20:56:25.653440 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] creating volume 'volume-f8896d9b-d453-458b-9137-4b5e37666eb4' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:56:25.655126 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:56:25.802832 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:56:25.803614 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:56:25.811025 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8289e07f-9794-493b-bbfd-61c6f6162e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8896d9b-d453-458b-9137-4b5e37666eb4', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:25.815379 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5082a21c-b1d6-420f-ac8b-9ee92aa6866f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:25.832289 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Volume volume-f8896d9b-d453-458b-9137-4b5e37666eb4 (f8896d9b-d453-458b-9137-4b5e37666eb4): created successfully Dec 11 20:56:25.839110 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5082a21c-b1d6-420f-ac8b-9ee92aa6866f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:25.845855 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Flow 'volume_create_manager' (79d70518-8926-44e5-81e7-b09e9347de5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:56:25.877734 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-0c55ccbe-4ef6-4c87-b14f-18a25ffe6c1b tempest-AttachVolumeTestJSON-496084914 None] Created volume successfully. Dec 11 20:56:27.362646 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-7467014d-e3aa-4da8-bc3b-8adb43ac41c9 req-baeb2246-86fb-4159-b2d1-d6262bf732fb tempest-AttachVolumeTestJSON-496084914 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:56:28.526442 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-7467014d-e3aa-4da8-bc3b-8adb43ac41c9 req-baeb2246-86fb-4159-b2d1-d6262bf732fb tempest-AttachVolumeTestJSON-496084914 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.164s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:56:28.539188 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-7467014d-e3aa-4da8-bc3b-8adb43ac41c9 req-baeb2246-86fb-4159-b2d1-d6262bf732fb tempest-AttachVolumeTestJSON-496084914 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f8896d9b-d453-458b-9137-4b5e37666eb4', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'f8896d9b-d453-458b-9137-4b5e37666eb4', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:56:28.581896 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-7467014d-e3aa-4da8-bc3b-8adb43ac41c9 req-baeb2246-86fb-4159-b2d1-d6262bf732fb tempest-AttachVolumeTestJSON-496084914 None] Connection info returned from driver {'name': 'volumes/volume-f8896d9b-d453-458b-9137-4b5e37666eb4', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f8896d9b-d453-458b-9137-4b5e37666eb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '40e89756-ad12-49cc-b056-88378117427d'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:56:28.669796 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-7467014d-e3aa-4da8-bc3b-8adb43ac41c9 req-baeb2246-86fb-4159-b2d1-d6262bf732fb tempest-AttachVolumeTestJSON-496084914 None] attachment_update completed successfully. Dec 11 20:56:29.964585 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-0b488512-249f-416b-b39d-69eb7806d047 req-62009d78-83b3-4051-9822-58db12074eac tempest-LiveAutoBlockMigrationV225Test-1350911859 None] Terminate volume connection completed successfully. Dec 11 20:56:29.965200 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-0b488512-249f-416b-b39d-69eb7806d047 req-62009d78-83b3-4051-9822-58db12074eac tempest-LiveAutoBlockMigrationV225Test-1350911859 None] Deleting attachment ea270f2a-1169-4042-a165-0afdf2ba3ddf. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 20:56:33.277794 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:56:33.285444 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:56:33.285944 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:56:33.300636 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Flow 'volume_create_manager' (f79af14d-b977-4c3a-92cd-0029d18e6a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:56:33.307025 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe79e13-c494-4b7f-ba15-e13a97aa3304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:33.320018 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:56:33.335000 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe79e13-c494-4b7f-ba15-e13a97aa3304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1024952829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71ca0e5dd444ebd831efebd5a556c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:56:33Z,use_quota=True,user_id='5e71e3d1252d4c38a8561813ba079605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:33.338428 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582b83e4-6f39-4d86-a66c-8b20d8b01370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:33.340976 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582b83e4-6f39-4d86-a66c-8b20d8b01370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:33.343911 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36036dfe-0f6e-4db2-81c2-b36a56eb80ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:33.442155 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36036dfe-0f6e-4db2-81c2-b36a56eb80ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07', 'volume_name': 'volume-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:33.444851 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be913bcf-5355-40ab-bf5d-a60386459400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:33.454654 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be913bcf-5355-40ab-bf5d-a60386459400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:33.457758 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffc65f9-420f-4927-98b3-8709ef31e34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:33.459112 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Volume bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 20:56:33.460312 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Cloning bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07 from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 20:56:33.475902 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:56:33.494886 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 20, 56, 33, 483800)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 20:56:33.495775 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 20:56:33.496463 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 20:56:33.503257 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.027s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:56:33.504557 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 20:56:33.527968 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 20, 56, 33, 511502)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 20:56:33.528637 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 20:56:33.529274 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 20:56:33.543016 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:56:33.621137 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] creating snapshot='volume-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 20:56:34.379658 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07.clone_snap' to 'volume-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 20:56:34.555737 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:56:34.557620 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:56:34.558195 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:56:34.593092 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 20:56:34.594355 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Marking volume bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07 as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 20:56:34.611877 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 20:56:34.613133 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Creating volume glance metadata for volume bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07 backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 20:56:34.699590 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffc65f9-420f-4927-98b3-8709ef31e34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:34.702182 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b15ee0-bc63-4fd8-b49d-a9b5cc67907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:34.714352 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Volume volume-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07 (bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07): created successfully Dec 11 20:56:34.717296 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b15ee0-bc63-4fd8-b49d-a9b5cc67907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:34.721588 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Flow 'volume_create_manager' (f79af14d-b977-4c3a-92cd-0029d18e6a54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:56:34.731732 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-df9e2b88-58b2-4199-b4a7-96efb66a480e tempest-TaggedBootDevicesTest_v242-10492700 None] Created volume successfully. Dec 11 20:56:35.839716 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:56:35.845840 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:56:35.847911 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:56:35.870450 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Flow 'volume_create_manager' (6b336408-3ef2-4492-afcb-0f3798168029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:56:35.885658 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a061d8e9-533d-4e3c-847c-9ae196e1eac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:35.895200 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:56:35.922821 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a061d8e9-533d-4e3c-847c-9ae196e1eac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1141194365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1cc24081-5bd3-4779-a26a-13ece3c04557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71ca0e5dd444ebd831efebd5a556c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:56:36Z,use_quota=True,user_id='5e71e3d1252d4c38a8561813ba079605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:35.939857 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1d896a-9e01-442e-a46b-9ec7ab7a26c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:35.942130 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1d896a-9e01-442e-a46b-9ec7ab7a26c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:35.944643 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d137f83-0fea-40b1-92d6-68a9094e2c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:35.947733 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d137f83-0fea-40b1-92d6-68a9094e2c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc24081-5bd3-4779-a26a-13ece3c04557', 'volume_name': 'volume-1cc24081-5bd3-4779-a26a-13ece3c04557', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:35.949795 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b9d212-84b0-487e-ab3f-1263d0df650a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:35.958852 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b9d212-84b0-487e-ab3f-1263d0df650a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:35.961158 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81f3640-da52-4896-a9b6-89172c8b18a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:35.961972 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Volume 1cc24081-5bd3-4779-a26a-13ece3c04557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc24081-5bd3-4779-a26a-13ece3c04557', 'volume_size': 1} Dec 11 20:56:35.963005 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] creating volume 'volume-1cc24081-5bd3-4779-a26a-13ece3c04557' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:56:35.964023 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:56:36.088405 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:56:36.089312 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:56:36.093213 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81f3640-da52-4896-a9b6-89172c8b18a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc24081-5bd3-4779-a26a-13ece3c04557', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:36.095802 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f95c739-60db-4862-8bc8-03f156b06b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:36.120266 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Volume volume-1cc24081-5bd3-4779-a26a-13ece3c04557 (1cc24081-5bd3-4779-a26a-13ece3c04557): created successfully Dec 11 20:56:36.122721 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f95c739-60db-4862-8bc8-03f156b06b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:36.125752 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Flow 'volume_create_manager' (6b336408-3ef2-4492-afcb-0f3798168029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:56:36.143844 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-98367332-38de-447b-8896-04f9bb7fd5de tempest-TaggedBootDevicesTest_v242-10492700 None] Created volume successfully. Dec 11 20:56:37.058735 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:56:37.062159 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:56:37.062628 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:56:37.075568 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Flow 'volume_create_manager' (3b1478de-7f41-4f33-a311-78b42befd4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:56:37.078780 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226ab8ea-faa1-424c-ac86-1ed706cb8c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:37.085006 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:56:37.098440 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226ab8ea-faa1-424c-ac86-1ed706cb8c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-869025485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2598d679-ec5a-4b7f-a18e-b0e2e1dd486c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71ca0e5dd444ebd831efebd5a556c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:56:37Z,use_quota=True,user_id='5e71e3d1252d4c38a8561813ba079605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:37.101414 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8930d5e-5c6c-4b12-92ec-94508e0c8867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:37.103721 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8930d5e-5c6c-4b12-92ec-94508e0c8867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:37.106127 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caca397d-c6d7-4c75-9565-dcf43db67f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:37.108440 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caca397d-c6d7-4c75-9565-dcf43db67f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2598d679-ec5a-4b7f-a18e-b0e2e1dd486c', 'volume_name': 'volume-2598d679-ec5a-4b7f-a18e-b0e2e1dd486c', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:37.110783 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005d8912-974c-4d89-b254-fcf7023eabe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:37.112912 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005d8912-974c-4d89-b254-fcf7023eabe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:37.115170 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd7dbd3-fdc1-4917-a5b0-f13188895aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:37.115952 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Volume 2598d679-ec5a-4b7f-a18e-b0e2e1dd486c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2598d679-ec5a-4b7f-a18e-b0e2e1dd486c', 'volume_size': 1} Dec 11 20:56:37.116351 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] creating volume 'volume-2598d679-ec5a-4b7f-a18e-b0e2e1dd486c' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:56:37.117335 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:56:37.176971 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:56:37.177947 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:56:37.180433 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd7dbd3-fdc1-4917-a5b0-f13188895aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2598d679-ec5a-4b7f-a18e-b0e2e1dd486c', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:37.182927 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bd2a20-ca11-45ee-b9ee-811a21881bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:37.191494 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Volume volume-2598d679-ec5a-4b7f-a18e-b0e2e1dd486c (2598d679-ec5a-4b7f-a18e-b0e2e1dd486c): created successfully Dec 11 20:56:37.193771 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bd2a20-ca11-45ee-b9ee-811a21881bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:37.197339 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Flow 'volume_create_manager' (3b1478de-7f41-4f33-a311-78b42befd4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:56:37.204569 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1d3f6fe6-0a57-4479-8877-b355f94c0b8d tempest-TaggedBootDevicesTest_v242-10492700 None] Created volume successfully. Dec 11 20:56:48.527859 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-5bcb3505-0bde-439d-808b-b53f959c3af0 tempest-TaggedBootDevicesTest_v242-10492700 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:56:49.249085 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-5bcb3505-0bde-439d-808b-b53f959c3af0 tempest-TaggedBootDevicesTest_v242-10492700 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.721s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:56:49.249894 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-5bcb3505-0bde-439d-808b-b53f959c3af0 tempest-TaggedBootDevicesTest_v242-10492700 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:56:49.294987 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-5bcb3505-0bde-439d-808b-b53f959c3af0 tempest-TaggedBootDevicesTest_v242-10492700 None] Connection info returned from driver {'name': 'volumes/volume-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a7e40a16-ca71-40a7-a784-32357bc57eb8'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:56:49.346790 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-5bcb3505-0bde-439d-808b-b53f959c3af0 tempest-TaggedBootDevicesTest_v242-10492700 None] attachment_update completed successfully. Dec 11 20:56:49.676333 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-971c8205-e44d-4eab-bb3b-7277b712162e tempest-TaggedBootDevicesTest_v242-10492700 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:56:50.450214 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-971c8205-e44d-4eab-bb3b-7277b712162e tempest-TaggedBootDevicesTest_v242-10492700 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.774s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:56:50.450940 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-971c8205-e44d-4eab-bb3b-7277b712162e tempest-TaggedBootDevicesTest_v242-10492700 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1cc24081-5bd3-4779-a26a-13ece3c04557', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '1cc24081-5bd3-4779-a26a-13ece3c04557', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:56:50.487322 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-971c8205-e44d-4eab-bb3b-7277b712162e tempest-TaggedBootDevicesTest_v242-10492700 None] Connection info returned from driver {'name': 'volumes/volume-1cc24081-5bd3-4779-a26a-13ece3c04557', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1cc24081-5bd3-4779-a26a-13ece3c04557', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'beb5982f-9917-4b4b-8f14-f44efb846ba8'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:56:50.559655 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-971c8205-e44d-4eab-bb3b-7277b712162e tempest-TaggedBootDevicesTest_v242-10492700 None] attachment_update completed successfully. Dec 11 20:56:50.990117 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-325afcdf-2b7f-4b19-918e-9e1610b77072 tempest-TaggedBootDevicesTest_v242-10492700 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:56:51.839060 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-325afcdf-2b7f-4b19-918e-9e1610b77072 tempest-TaggedBootDevicesTest_v242-10492700 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.848s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:56:51.839856 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-325afcdf-2b7f-4b19-918e-9e1610b77072 tempest-TaggedBootDevicesTest_v242-10492700 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2598d679-ec5a-4b7f-a18e-b0e2e1dd486c', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '2598d679-ec5a-4b7f-a18e-b0e2e1dd486c', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:56:51.891331 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-325afcdf-2b7f-4b19-918e-9e1610b77072 tempest-TaggedBootDevicesTest_v242-10492700 None] Connection info returned from driver {'name': 'volumes/volume-2598d679-ec5a-4b7f-a18e-b0e2e1dd486c', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2598d679-ec5a-4b7f-a18e-b0e2e1dd486c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8c272a33-be56-4849-afc7-de6774b87a4d'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:56:51.963726 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-598e643a-2453-4933-97f8-956d2af5b3c5 req-325afcdf-2b7f-4b19-918e-9e1610b77072 tempest-TaggedBootDevicesTest_v242-10492700 None] attachment_update completed successfully. Dec 11 20:56:54.014980 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-576253b9-bac0-42c2-a96c-eeef6a66c8cd req-9f6d7615-5eab-4dcf-bb7d-fa3574511a77 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Terminate volume connection completed successfully. Dec 11 20:56:54.015748 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-576253b9-bac0-42c2-a96c-eeef6a66c8cd req-9f6d7615-5eab-4dcf-bb7d-fa3574511a77 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Deleting attachment 1f3a9c29-e2e2-4fe9-ae36-90c3e8440332. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 20:56:55.059286 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:56:55.059931 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:56:55.146312 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:56:55.219855 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:56:55.736039 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:56:55.741839 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:56:55.744381 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:56:55.766296 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Flow 'volume_create_manager' (13fdc9c5-a876-470e-9bce-d0d7cb7f9466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:56:55.771641 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da282247-a87f-47f1-992e-2f5189fabbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:55.782873 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:56:55.798708 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da282247-a87f-47f1-992e-2f5189fabbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-722411647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=be24a1b4-89d0-466f-a8ab-5fe44740018f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf310bd024341a09265e9c0cf0a61cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:56:56Z,use_quota=True,user_id='33256b4f50d24bdfbc1761b88b5c9189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:55.803115 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d2482a-3443-460e-865e-3cc8a70b78cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:55.806506 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d2482a-3443-460e-865e-3cc8a70b78cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:55.811280 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187d1381-b292-4019-a241-c177db3bfc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:55.943069 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187d1381-b292-4019-a241-c177db3bfc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be24a1b4-89d0-466f-a8ab-5fe44740018f', 'volume_name': 'volume-be24a1b4-89d0-466f-a8ab-5fe44740018f', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:55.945831 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb0eee3-47c4-4b34-ab92-e62da6ef5340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:55.948799 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb0eee3-47c4-4b34-ab92-e62da6ef5340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:55.951055 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c25fc7-17f2-4ed4-83ed-5e277f48393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:55.952083 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Volume be24a1b4-89d0-466f-a8ab-5fe44740018f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be24a1b4-89d0-466f-a8ab-5fe44740018f', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 20:56:55.952865 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Cloning be24a1b4-89d0-466f-a8ab-5fe44740018f from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 20:56:55.964883 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:56:55.981044 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 20, 56, 55, 970607)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 20:56:55.982169 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 20:56:55.982608 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 20:56:55.989727 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:56:55.990706 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 20:56:55.996459 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 20, 56, 55, 994072)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 20:56:55.997081 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 20:56:55.997632 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 20:56:56.018320 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:56:56.130983 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] creating snapshot='volume-be24a1b4-89d0-466f-a8ab-5fe44740018f.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 20:56:57.082908 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-be24a1b4-89d0-466f-a8ab-5fe44740018f.clone_snap' to 'volume-be24a1b4-89d0-466f-a8ab-5fe44740018f' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 20:56:57.302463 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:56:57.304424 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:56:57.306028 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:56:57.332050 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 20:56:57.332775 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Marking volume be24a1b4-89d0-466f-a8ab-5fe44740018f as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 20:56:57.343291 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to be24a1b4-89d0-466f-a8ab-5fe44740018f. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 20:56:57.344210 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Creating volume glance metadata for volume be24a1b4-89d0-466f-a8ab-5fe44740018f backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 20:56:57.433458 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c25fc7-17f2-4ed4-83ed-5e277f48393b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be24a1b4-89d0-466f-a8ab-5fe44740018f', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:57.436018 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643ce685-2b3d-44f2-a471-4b2a75084c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:56:57.449275 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Volume volume-be24a1b4-89d0-466f-a8ab-5fe44740018f (be24a1b4-89d0-466f-a8ab-5fe44740018f): created successfully Dec 11 20:56:57.454005 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643ce685-2b3d-44f2-a471-4b2a75084c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:56:57.464292 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Flow 'volume_create_manager' (13fdc9c5-a876-470e-9bce-d0d7cb7f9466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:56:57.478140 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-3a522c46-b19d-480f-9228-6d10c7d299e4 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Created volume successfully. Dec 11 20:57:00.648488 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-502f3dc5-b064-4a1d-ac08-3f77b1ce9a11 req-b962257a-61a8-4a55-823c-df57990a6c62 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:57:01.542651 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-502f3dc5-b064-4a1d-ac08-3f77b1ce9a11 req-b962257a-61a8-4a55-823c-df57990a6c62 tempest-LiveAutoBlockMigrationV225Test-197978676 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.894s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:57:01.543347 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-502f3dc5-b064-4a1d-ac08-3f77b1ce9a11 req-b962257a-61a8-4a55-823c-df57990a6c62 tempest-LiveAutoBlockMigrationV225Test-197978676 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-be24a1b4-89d0-466f-a8ab-5fe44740018f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'be24a1b4-89d0-466f-a8ab-5fe44740018f', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:57:01.566811 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-502f3dc5-b064-4a1d-ac08-3f77b1ce9a11 req-b962257a-61a8-4a55-823c-df57990a6c62 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Connection info returned from driver {'name': 'volumes/volume-be24a1b4-89d0-466f-a8ab-5fe44740018f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'be24a1b4-89d0-466f-a8ab-5fe44740018f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '93aee304-c0a1-4aee-87e5-870a842d093b'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:57:01.623462 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-502f3dc5-b064-4a1d-ac08-3f77b1ce9a11 req-b962257a-61a8-4a55-823c-df57990a6c62 tempest-LiveAutoBlockMigrationV225Test-197978676 None] attachment_update completed successfully. Dec 11 20:57:15.333443 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:57:15.339201 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:57:15.340542 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:57:15.376739 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Flow 'volume_create_manager' (fcf73fc4-24b3-4e33-b1e5-e41c033e3681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:57:15.380679 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d5feff-eefd-40bb-902c-3a9cc67357c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:57:15.392149 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:57:15.407642 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d5feff-eefd-40bb-902c-3a9cc67357c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1833649631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=137a90da-6642-41d0-9f99-631c12ed1b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b8bef4801403db9dc65e4c9fcf464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:57:15Z,use_quota=True,user_id='18a84cbbc9104fbf868f42918de5da19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:57:15.410842 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19182406-f247-4f38-8672-968835d76de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:57:15.413386 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19182406-f247-4f38-8672-968835d76de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:57:15.417214 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c255e119-e157-422e-b70a-8f15c38851d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:57:15.419891 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c255e119-e157-422e-b70a-8f15c38851d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '137a90da-6642-41d0-9f99-631c12ed1b96', 'volume_name': 'volume-137a90da-6642-41d0-9f99-631c12ed1b96', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:57:15.422615 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e360f12d-6939-4fc6-9f9e-40bda7a57098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:57:15.425451 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e360f12d-6939-4fc6-9f9e-40bda7a57098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:57:15.428345 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c790d0a-af36-4d1c-a38d-e3ce5296a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:57:15.429416 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Volume 137a90da-6642-41d0-9f99-631c12ed1b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-137a90da-6642-41d0-9f99-631c12ed1b96', 'volume_size': 1} Dec 11 20:57:15.430042 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] creating volume 'volume-137a90da-6642-41d0-9f99-631c12ed1b96' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:57:15.431906 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:57:15.558236 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:57:15.558642 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:57:15.560675 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c790d0a-af36-4d1c-a38d-e3ce5296a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-137a90da-6642-41d0-9f99-631c12ed1b96', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:57:15.562957 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b75beff-4639-4556-bba6-b6fc54d88c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:57:15.582921 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Volume volume-137a90da-6642-41d0-9f99-631c12ed1b96 (137a90da-6642-41d0-9f99-631c12ed1b96): created successfully Dec 11 20:57:15.586095 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b75beff-4639-4556-bba6-b6fc54d88c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:57:15.591030 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Flow 'volume_create_manager' (fcf73fc4-24b3-4e33-b1e5-e41c033e3681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:57:15.601143 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-a9f56a68-f2cc-4e3f-8720-5b0accae192a tempest-ServerRescueNegativeTestJSON-997522025 None] Created volume successfully. Dec 11 20:57:25.827204 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-54d8bd03-38ce-4d18-af99-036e7035316a req-43f13d8e-bbd7-4adb-92e0-a50efcc5a7c7 tempest-LiveAutoBlockMigrationV225Test-1350911859 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:57:26.725612 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-54d8bd03-38ce-4d18-af99-036e7035316a req-43f13d8e-bbd7-4adb-92e0-a50efcc5a7c7 tempest-LiveAutoBlockMigrationV225Test-1350911859 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.898s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:57:26.727248 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-54d8bd03-38ce-4d18-af99-036e7035316a req-43f13d8e-bbd7-4adb-92e0-a50efcc5a7c7 tempest-LiveAutoBlockMigrationV225Test-1350911859 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-be24a1b4-89d0-466f-a8ab-5fe44740018f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'be24a1b4-89d0-466f-a8ab-5fe44740018f', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:57:26.770907 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-54d8bd03-38ce-4d18-af99-036e7035316a req-43f13d8e-bbd7-4adb-92e0-a50efcc5a7c7 tempest-LiveAutoBlockMigrationV225Test-1350911859 None] Connection info returned from driver {'name': 'volumes/volume-be24a1b4-89d0-466f-a8ab-5fe44740018f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'be24a1b4-89d0-466f-a8ab-5fe44740018f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3322557d-c2a3-4504-8442-97c34059e217'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:57:26.879848 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-54d8bd03-38ce-4d18-af99-036e7035316a req-43f13d8e-bbd7-4adb-92e0-a50efcc5a7c7 tempest-LiveAutoBlockMigrationV225Test-1350911859 None] attachment_update completed successfully. Dec 11 20:57:28.528156 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-3ce52d2d-82f6-4f06-864e-191f0ae2d4a7 req-7caa0b37-a51c-46ba-bf06-ff1bbe67a15f tempest-AttachVolumeTestJSON-496084914 None] Terminate volume connection completed successfully. Dec 11 20:57:28.529461 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-3ce52d2d-82f6-4f06-864e-191f0ae2d4a7 req-7caa0b37-a51c-46ba-bf06-ff1bbe67a15f tempest-AttachVolumeTestJSON-496084914 None] Deleting attachment 40e89756-ad12-49cc-b056-88378117427d. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 20:57:35.041687 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-54d8bd03-38ce-4d18-af99-036e7035316a req-a5ddd47b-80ec-4271-8028-097b00e4694d tempest-LiveAutoBlockMigrationV225Test-1350911859 None] Terminate volume connection completed successfully. Dec 11 20:57:35.042395 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-54d8bd03-38ce-4d18-af99-036e7035316a req-a5ddd47b-80ec-4271-8028-097b00e4694d tempest-LiveAutoBlockMigrationV225Test-1350911859 None] Deleting attachment 93aee304-c0a1-4aee-87e5-870a842d093b. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 20:57:42.770377 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-b7924522-8375-4715-8740-f0c9be97e4da req-5f401972-13a9-4a3e-94eb-917cf69bf510 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Terminate volume connection completed successfully. Dec 11 20:57:42.771042 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-b7924522-8375-4715-8740-f0c9be97e4da req-5f401972-13a9-4a3e-94eb-917cf69bf510 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Deleting attachment 3322557d-c2a3-4504-8442-97c34059e217. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 20:57:42.891038 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-b7924522-8375-4715-8740-f0c9be97e4da req-789263ff-87d9-4025-85d7-1e53a27580e1 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Lock "b'cinder-be24a1b4-89d0-466f-a8ab-5fe44740018f-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:57:42.955033 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-b7924522-8375-4715-8740-f0c9be97e4da req-789263ff-87d9-4025-85d7-1e53a27580e1 tempest-LiveAutoBlockMigrationV225Test-197978676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:57:43.062719 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-b7924522-8375-4715-8740-f0c9be97e4da req-789263ff-87d9-4025-85d7-1e53a27580e1 tempest-LiveAutoBlockMigrationV225Test-197978676 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 20:57:43.076348 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-b7924522-8375-4715-8740-f0c9be97e4da req-789263ff-87d9-4025-85d7-1e53a27580e1 tempest-LiveAutoBlockMigrationV225Test-197978676 None] deleting rbd volume volume-be24a1b4-89d0-466f-a8ab-5fe44740018f {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 20:57:43.110389 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 20:57:43.115506 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 20:57:43.116903 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 20:57:43.135676 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Flow 'volume_create_manager' (996e8ac5-0a7d-478e-a903-a0561f72a11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:57:43.143698 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38893549-7080-4375-8429-941b410ebd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:57:43.156136 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 20:57:43.192742 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38893549-7080-4375-8429-941b410ebd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T20:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1771476491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=885cbf69-4141-4d54-b3d4-193932c5960f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b8bef4801403db9dc65e4c9fcf464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T20:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T20:57:43Z,use_quota=True,user_id='18a84cbbc9104fbf868f42918de5da19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:57:43.196833 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffd0ee0-09c1-4b2e-90a5-9a49ef40a794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:57:43.201129 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffd0ee0-09c1-4b2e-90a5-9a49ef40a794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:57:43.203909 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e331cb0-f722-4fc6-b20f-5568375b8d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:57:43.206667 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e331cb0-f722-4fc6-b20f-5568375b8d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '885cbf69-4141-4d54-b3d4-193932c5960f', 'volume_name': 'volume-885cbf69-4141-4d54-b3d4-193932c5960f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:57:43.209153 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162d9da3-7ee2-46ab-ba37-0586abac1cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:57:43.212606 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162d9da3-7ee2-46ab-ba37-0586abac1cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:57:43.215421 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afed87e1-92f5-40fe-b8f0-e9863dedcae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:57:43.216237 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Volume 885cbf69-4141-4d54-b3d4-193932c5960f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-885cbf69-4141-4d54-b3d4-193932c5960f', 'volume_size': 1} Dec 11 20:57:43.216674 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] creating volume 'volume-885cbf69-4141-4d54-b3d4-193932c5960f' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 20:57:43.217777 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:57:43.341691 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 20:57:43.342387 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 20:57:43.345719 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afed87e1-92f5-40fe-b8f0-e9863dedcae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885cbf69-4141-4d54-b3d4-193932c5960f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:57:43.348801 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28e16dd-0a36-46f8-b63a-6ad0cb7eb6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 20:57:43.364999 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Volume volume-885cbf69-4141-4d54-b3d4-193932c5960f (885cbf69-4141-4d54-b3d4-193932c5960f): created successfully Dec 11 20:57:43.369987 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28e16dd-0a36-46f8-b63a-6ad0cb7eb6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 20:57:43.377232 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Flow 'volume_create_manager' (996e8ac5-0a7d-478e-a903-a0561f72a11c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 20:57:43.389461 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9ebbb76e-ff8b-4b29-b10a-b7c6831cbe8d tempest-ServerRescueNegativeTestJSON-997522025 None] Created volume successfully. Dec 11 20:57:43.445360 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-b7924522-8375-4715-8740-f0c9be97e4da req-789263ff-87d9-4025-85d7-1e53a27580e1 tempest-LiveAutoBlockMigrationV225Test-197978676 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 20:57:43.509905 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-b7924522-8375-4715-8740-f0c9be97e4da req-789263ff-87d9-4025-85d7-1e53a27580e1 tempest-LiveAutoBlockMigrationV225Test-197978676 None] deleting parent snapshot volume-be24a1b4-89d0-466f-a8ab-5fe44740018f.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 20:57:44.432188 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-579d6526-7609-40df-86da-20d0ff712803 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Lock "b'cinder-e515830a-7134-4859-a11a-6f2e811d1996-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:57:44.489567 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [req-b7924522-8375-4715-8740-f0c9be97e4da req-789263ff-87d9-4025-85d7-1e53a27580e1 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Created reservations ['800b3d24-ed60-4edf-9e25-a8718372216e', '24ebef84-5000-4404-83f3-c5501887fb22', '61bb6953-5932-4a16-90fe-0f3364d70ea5', 'b2a73fcb-a752-46c7-847d-c4b4b5f13956'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 20:57:44.504857 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-579d6526-7609-40df-86da-20d0ff712803 tempest-LiveAutoBlockMigrationV225Test-197978676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:57:44.562839 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-579d6526-7609-40df-86da-20d0ff712803 tempest-LiveAutoBlockMigrationV225Test-197978676 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 20:57:44.563285 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-579d6526-7609-40df-86da-20d0ff712803 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Volume volume-e515830a-7134-4859-a11a-6f2e811d1996 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:57:44.572957 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-579d6526-7609-40df-86da-20d0ff712803 tempest-LiveAutoBlockMigrationV225Test-197978676 None] deleting rbd volume volume-e515830a-7134-4859-a11a-6f2e811d1996 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 20:57:44.618005 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-b7924522-8375-4715-8740-f0c9be97e4da req-789263ff-87d9-4025-85d7-1e53a27580e1 tempest-LiveAutoBlockMigrationV225Test-197978676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:57:44.660923 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-b7924522-8375-4715-8740-f0c9be97e4da req-789263ff-87d9-4025-85d7-1e53a27580e1 tempest-LiveAutoBlockMigrationV225Test-197978676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:57:44.712895 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [req-b7924522-8375-4715-8740-f0c9be97e4da req-789263ff-87d9-4025-85d7-1e53a27580e1 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:57:44.718556 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-b7924522-8375-4715-8740-f0c9be97e4da req-789263ff-87d9-4025-85d7-1e53a27580e1 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Deleted volume successfully. Dec 11 20:57:44.739342 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-b7924522-8375-4715-8740-f0c9be97e4da req-789263ff-87d9-4025-85d7-1e53a27580e1 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Lock "b'cinder-be24a1b4-89d0-466f-a8ab-5fe44740018f-delete_volume'" released by "delete_volume" :: held 1.849s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:57:44.916617 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-d0a96e32-fa51-4b45-8590-750973a7c4d0 req-67a9e9d0-eb52-4080-b95f-dd1d8f90823f tempest-ServerRescueNegativeTestJSON-997522025 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 20:57:45.199031 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-579d6526-7609-40df-86da-20d0ff712803 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Created reservations ['a4588dc0-a817-4cc2-9295-14c008fb6e90', '390e9d40-b7bc-42af-b484-43c28848d40e', '2df69c9c-4887-4a8b-abf4-dfc3d2bf05d5', 'eee98155-1f9e-41f7-a939-5d90bcea3251'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 20:57:45.280765 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-579d6526-7609-40df-86da-20d0ff712803 tempest-LiveAutoBlockMigrationV225Test-197978676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:57:45.341635 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-579d6526-7609-40df-86da-20d0ff712803 tempest-LiveAutoBlockMigrationV225Test-197978676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:57:45.413416 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-579d6526-7609-40df-86da-20d0ff712803 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:57:45.421482 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-579d6526-7609-40df-86da-20d0ff712803 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Deleted volume successfully. Dec 11 20:57:45.444271 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-579d6526-7609-40df-86da-20d0ff712803 tempest-LiveAutoBlockMigrationV225Test-197978676 None] Lock "b'cinder-e515830a-7134-4859-a11a-6f2e811d1996-delete_volume'" released by "delete_volume" :: held 1.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:57:45.758341 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-d0a96e32-fa51-4b45-8590-750973a7c4d0 req-67a9e9d0-eb52-4080-b95f-dd1d8f90823f tempest-ServerRescueNegativeTestJSON-997522025 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.837s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 20:57:45.758341 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-d0a96e32-fa51-4b45-8590-750973a7c4d0 req-67a9e9d0-eb52-4080-b95f-dd1d8f90823f tempest-ServerRescueNegativeTestJSON-997522025 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-885cbf69-4141-4d54-b3d4-193932c5960f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '885cbf69-4141-4d54-b3d4-193932c5960f', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 20:57:45.799900 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-d0a96e32-fa51-4b45-8590-750973a7c4d0 req-67a9e9d0-eb52-4080-b95f-dd1d8f90823f tempest-ServerRescueNegativeTestJSON-997522025 None] Connection info returned from driver {'name': 'volumes/volume-885cbf69-4141-4d54-b3d4-193932c5960f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '885cbf69-4141-4d54-b3d4-193932c5960f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dd10e6c2-cbd7-4cb7-9a76-e6a5f3c347c5'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 20:57:45.863951 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-d0a96e32-fa51-4b45-8590-750973a7c4d0 req-67a9e9d0-eb52-4080-b95f-dd1d8f90823f tempest-ServerRescueNegativeTestJSON-997522025 None] attachment_update completed successfully. Dec 11 20:57:55.057524 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:57:55.059670 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:57:55.091298 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:57:55.115419 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:58:29.368537 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-ac056dd0-d180-4952-b1aa-5b85b7aa5602 req-00f22762-cc2b-4010-8b48-600a83d990b4 tempest-ServerRescueNegativeTestJSON-997522025 None] Terminate volume connection completed successfully. Dec 11 20:58:29.369746 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-ac056dd0-d180-4952-b1aa-5b85b7aa5602 req-00f22762-cc2b-4010-8b48-600a83d990b4 tempest-ServerRescueNegativeTestJSON-997522025 None] Deleting attachment dd10e6c2-cbd7-4cb7-9a76-e6a5f3c347c5. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 20:58:29.953648 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-1a7772a8-b42d-4538-af24-111835e7ef26 tempest-ServerRescueNegativeTestJSON-997522025 None] Lock "b'cinder-885cbf69-4141-4d54-b3d4-193932c5960f-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:58:30.003891 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a7772a8-b42d-4538-af24-111835e7ef26 tempest-ServerRescueNegativeTestJSON-997522025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:58:30.045031 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a7772a8-b42d-4538-af24-111835e7ef26 tempest-ServerRescueNegativeTestJSON-997522025 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 20:58:30.045569 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a7772a8-b42d-4538-af24-111835e7ef26 tempest-ServerRescueNegativeTestJSON-997522025 None] Volume volume-885cbf69-4141-4d54-b3d4-193932c5960f is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:58:30.053647 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a7772a8-b42d-4538-af24-111835e7ef26 tempest-ServerRescueNegativeTestJSON-997522025 None] deleting rbd volume volume-885cbf69-4141-4d54-b3d4-193932c5960f {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 20:58:30.402601 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-1a7772a8-b42d-4538-af24-111835e7ef26 tempest-ServerRescueNegativeTestJSON-997522025 None] Created reservations ['f28a5a6c-35b0-4e73-974f-f074d837f0e2', '0d5d9646-3813-42e3-8bb7-5472ffc7e65f', 'e438fa95-f401-4686-96fa-f29bb8c23fed', 'f8db2341-e19c-4b65-bc89-ce73b4ecf78a'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 20:58:30.459096 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a7772a8-b42d-4538-af24-111835e7ef26 tempest-ServerRescueNegativeTestJSON-997522025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:58:30.502530 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1a7772a8-b42d-4538-af24-111835e7ef26 tempest-ServerRescueNegativeTestJSON-997522025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:58:30.533757 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-1a7772a8-b42d-4538-af24-111835e7ef26 tempest-ServerRescueNegativeTestJSON-997522025 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:58:30.538916 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1a7772a8-b42d-4538-af24-111835e7ef26 tempest-ServerRescueNegativeTestJSON-997522025 None] Deleted volume successfully. Dec 11 20:58:30.550949 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-1a7772a8-b42d-4538-af24-111835e7ef26 tempest-ServerRescueNegativeTestJSON-997522025 None] Lock "b'cinder-885cbf69-4141-4d54-b3d4-193932c5960f-delete_volume'" released by "delete_volume" :: held 0.597s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:58:31.084084 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-0b47b06c-dbd7-4935-9237-caf42507e04a tempest-ServerRescueNegativeTestJSON-997522025 None] Lock "b'cinder-137a90da-6642-41d0-9f99-631c12ed1b96-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 20:58:31.122907 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0b47b06c-dbd7-4935-9237-caf42507e04a tempest-ServerRescueNegativeTestJSON-997522025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:58:31.164643 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0b47b06c-dbd7-4935-9237-caf42507e04a tempest-ServerRescueNegativeTestJSON-997522025 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 20:58:31.165487 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0b47b06c-dbd7-4935-9237-caf42507e04a tempest-ServerRescueNegativeTestJSON-997522025 None] Volume volume-137a90da-6642-41d0-9f99-631c12ed1b96 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 20:58:31.171704 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0b47b06c-dbd7-4935-9237-caf42507e04a tempest-ServerRescueNegativeTestJSON-997522025 None] deleting rbd volume volume-137a90da-6642-41d0-9f99-631c12ed1b96 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 20:58:31.499733 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-0b47b06c-dbd7-4935-9237-caf42507e04a tempest-ServerRescueNegativeTestJSON-997522025 None] Created reservations ['8aa922b1-0386-464e-9912-20c30a73640b', '95f04a0d-2a38-46e1-8092-e0aae4834484', '2c5bbb0f-201a-4d00-ab27-590c6c25512a', '50f1c6f2-91c3-4294-99f5-6142acbbb502'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 20:58:31.548745 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0b47b06c-dbd7-4935-9237-caf42507e04a tempest-ServerRescueNegativeTestJSON-997522025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:58:31.603248 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0b47b06c-dbd7-4935-9237-caf42507e04a tempest-ServerRescueNegativeTestJSON-997522025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:58:31.649065 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-0b47b06c-dbd7-4935-9237-caf42507e04a tempest-ServerRescueNegativeTestJSON-997522025 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:58:31.655496 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-0b47b06c-dbd7-4935-9237-caf42507e04a tempest-ServerRescueNegativeTestJSON-997522025 None] Deleted volume successfully. Dec 11 20:58:31.671926 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-0b47b06c-dbd7-4935-9237-caf42507e04a tempest-ServerRescueNegativeTestJSON-997522025 None] Lock "b'cinder-137a90da-6642-41d0-9f99-631c12ed1b96-delete_volume'" released by "delete_volume" :: held 0.588s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 20:58:55.060355 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:58:55.061375 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:58:55.135160 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:58:55.218153 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 20:59:55.059532 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 20:59:55.060193 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:59:55.127618 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 20:59:55.209708 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:00:51.781915 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:00:51.790266 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:00:51.792006 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:00:51.818098 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Flow 'volume_create_manager' (2e286909-8dc1-4929-9f8f-16653515be41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:00:51.822940 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d796f5d-d1f8-4032-badf-a21b6d4f3965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:00:51.831492 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:00:51.847663 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d796f5d-d1f8-4032-badf-a21b6d4f3965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1263075208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4b0f1f89-d730-4940-bf8e-78b633d9c4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c90b7fcfb224a9c8a763b229c09b4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:00:52Z,use_quota=True,user_id='d73b3e9cb4ea483b829bc830afe6329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:00:51.850906 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee90dff2-ef9c-4b82-8d75-6e94c5041152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:00:51.853379 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee90dff2-ef9c-4b82-8d75-6e94c5041152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:00:51.856094 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6728c7b1-ba20-4836-a174-a91b849f15d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:00:51.858599 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6728c7b1-ba20-4836-a174-a91b849f15d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0f1f89-d730-4940-bf8e-78b633d9c4f1', 'volume_name': 'volume-4b0f1f89-d730-4940-bf8e-78b633d9c4f1', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:00:51.861779 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48833c2-4ac3-4273-add2-ce3387975bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:00:51.864195 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48833c2-4ac3-4273-add2-ce3387975bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:00:51.866689 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c13a70-d3c9-41ce-998d-3403e1118172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:00:51.867504 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Volume 4b0f1f89-d730-4940-bf8e-78b633d9c4f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0f1f89-d730-4940-bf8e-78b633d9c4f1', 'volume_size': 1} Dec 11 21:00:51.867913 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] creating volume 'volume-4b0f1f89-d730-4940-bf8e-78b633d9c4f1' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:00:51.868913 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:00:51.989148 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:00:51.989575 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:00:51.994842 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c13a70-d3c9-41ce-998d-3403e1118172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0f1f89-d730-4940-bf8e-78b633d9c4f1', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:00:51.997926 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965da9e1-4291-4746-9bcc-9932615096c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:00:52.012218 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Volume volume-4b0f1f89-d730-4940-bf8e-78b633d9c4f1 (4b0f1f89-d730-4940-bf8e-78b633d9c4f1): created successfully Dec 11 21:00:52.018127 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965da9e1-4291-4746-9bcc-9932615096c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:00:52.027512 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Flow 'volume_create_manager' (2e286909-8dc1-4929-9f8f-16653515be41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:00:52.047108 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1f9a4522-0d23-460f-bba5-419bc0fdc58a tempest-AttachVolumeTestJSON-496084914 None] Created volume successfully. Dec 11 21:00:53.596799 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-fa190e3e-b601-4f57-a211-3346498d4ebe req-db8ef0d2-1dec-4165-9ab8-5e0a3b7530fb tempest-AttachVolumeTestJSON-496084914 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:00:54.982335 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-fa190e3e-b601-4f57-a211-3346498d4ebe req-db8ef0d2-1dec-4165-9ab8-5e0a3b7530fb tempest-AttachVolumeTestJSON-496084914 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.385s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:00:54.983812 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-fa190e3e-b601-4f57-a211-3346498d4ebe req-db8ef0d2-1dec-4165-9ab8-5e0a3b7530fb tempest-AttachVolumeTestJSON-496084914 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4b0f1f89-d730-4940-bf8e-78b633d9c4f1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '4b0f1f89-d730-4940-bf8e-78b633d9c4f1', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:00:55.038083 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-fa190e3e-b601-4f57-a211-3346498d4ebe req-db8ef0d2-1dec-4165-9ab8-5e0a3b7530fb tempest-AttachVolumeTestJSON-496084914 None] Connection info returned from driver {'name': 'volumes/volume-4b0f1f89-d730-4940-bf8e-78b633d9c4f1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4b0f1f89-d730-4940-bf8e-78b633d9c4f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '66779b8b-b271-4315-ae00-f774990b1fb8'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:00:55.057380 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:00:55.059703 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:00:55.133414 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:00:55.229237 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:00:55.354987 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-fa190e3e-b601-4f57-a211-3346498d4ebe req-db8ef0d2-1dec-4165-9ab8-5e0a3b7530fb tempest-AttachVolumeTestJSON-496084914 None] attachment_update completed successfully. Dec 11 21:00:57.535934 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:00:57.539983 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:00:57.541259 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:00:57.554734 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Flow 'volume_create_manager' (910b0a42-e372-499c-b183-bbeb0d711714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:00:57.558160 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd2a457-ba48-43df-8cc8-88af98351073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:00:57.565555 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:00:57.579435 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd2a457-ba48-43df-8cc8-88af98351073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-247433728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6d218a8d-14e8-4548-bd7c-d1dc9448b64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c90b7fcfb224a9c8a763b229c09b4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:00:57Z,use_quota=True,user_id='d73b3e9cb4ea483b829bc830afe6329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:00:57.583320 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e244a71b-3dce-4d59-b44a-1baf8c1d8b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:00:57.586423 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e244a71b-3dce-4d59-b44a-1baf8c1d8b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:00:57.589070 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe510188-24d5-415b-8ceb-fe689ead45f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:00:57.591504 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe510188-24d5-415b-8ceb-fe689ead45f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d218a8d-14e8-4548-bd7c-d1dc9448b64d', 'volume_name': 'volume-6d218a8d-14e8-4548-bd7c-d1dc9448b64d', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:00:57.594198 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc4366b-5dad-4563-b229-0c0bc5081ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:00:57.596796 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc4366b-5dad-4563-b229-0c0bc5081ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:00:57.599171 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898261ba-6437-4c54-a4de-052fa28ff94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:00:57.600048 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Volume 6d218a8d-14e8-4548-bd7c-d1dc9448b64d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d218a8d-14e8-4548-bd7c-d1dc9448b64d', 'volume_size': 1} Dec 11 21:00:57.600537 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] creating volume 'volume-6d218a8d-14e8-4548-bd7c-d1dc9448b64d' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:00:57.601646 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:00:57.690117 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:00:57.690117 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:00:57.692300 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898261ba-6437-4c54-a4de-052fa28ff94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d218a8d-14e8-4548-bd7c-d1dc9448b64d', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:00:57.694546 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51240d97-191b-4b10-8407-8c401d5bcc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:00:57.714901 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Volume volume-6d218a8d-14e8-4548-bd7c-d1dc9448b64d (6d218a8d-14e8-4548-bd7c-d1dc9448b64d): created successfully Dec 11 21:00:57.718189 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51240d97-191b-4b10-8407-8c401d5bcc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:00:57.722264 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Flow 'volume_create_manager' (910b0a42-e372-499c-b183-bbeb0d711714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:00:57.737642 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b32c914b-a360-4f31-9210-dbaf075a8ef8 tempest-AttachVolumeTestJSON-496084914 None] Created volume successfully. Dec 11 21:00:59.354858 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-a6e3846c-e5b6-4134-a8f7-8eadee0b8a4e req-9d8af904-289a-4689-b259-601977041f2d tempest-AttachVolumeTestJSON-496084914 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:01:00.415698 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-a6e3846c-e5b6-4134-a8f7-8eadee0b8a4e req-9d8af904-289a-4689-b259-601977041f2d tempest-AttachVolumeTestJSON-496084914 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.061s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:01:00.416593 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a6e3846c-e5b6-4134-a8f7-8eadee0b8a4e req-9d8af904-289a-4689-b259-601977041f2d tempest-AttachVolumeTestJSON-496084914 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6d218a8d-14e8-4548-bd7c-d1dc9448b64d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '6d218a8d-14e8-4548-bd7c-d1dc9448b64d', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:01:00.477752 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a6e3846c-e5b6-4134-a8f7-8eadee0b8a4e req-9d8af904-289a-4689-b259-601977041f2d tempest-AttachVolumeTestJSON-496084914 None] Connection info returned from driver {'name': 'volumes/volume-6d218a8d-14e8-4548-bd7c-d1dc9448b64d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6d218a8d-14e8-4548-bd7c-d1dc9448b64d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2623be69-8bf6-4845-b4f5-9001588303bc'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:01:00.548310 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-a6e3846c-e5b6-4134-a8f7-8eadee0b8a4e req-9d8af904-289a-4689-b259-601977041f2d tempest-AttachVolumeTestJSON-496084914 None] attachment_update completed successfully. Dec 11 21:01:03.777388 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-2ef4799f-6a94-47ac-8173-b900010ac371 req-1f991179-ac78-4925-83ed-46720c380cda tempest-AttachVolumeTestJSON-496084914 None] Terminate volume connection completed successfully. Dec 11 21:01:03.779006 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-2ef4799f-6a94-47ac-8173-b900010ac371 req-1f991179-ac78-4925-83ed-46720c380cda tempest-AttachVolumeTestJSON-496084914 None] Deleting attachment 66779b8b-b271-4315-ae00-f774990b1fb8. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:01:05.271706 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-1e456e50-976d-4fc0-a288-a088947bb3a7 req-f43e5302-6eba-4feb-b1c5-6882492813b0 tempest-AttachVolumeTestJSON-496084914 None] Terminate volume connection completed successfully. Dec 11 21:01:05.272376 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-1e456e50-976d-4fc0-a288-a088947bb3a7 req-f43e5302-6eba-4feb-b1c5-6882492813b0 tempest-AttachVolumeTestJSON-496084914 None] Deleting attachment 2623be69-8bf6-4845-b4f5-9001588303bc. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:01:12.830175 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d6eccbf5-da5b-44a8-8b81-662e87d91faa tempest-GroupsTest-1997969427 None] Group tempest-Group1-1315499304: creating Dec 11 21:01:12.905257 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d6eccbf5-da5b-44a8-8b81-662e87d91faa tempest-GroupsTest-1997969427 None] Group tempest-Group1-1315499304: created successfully Dec 11 21:01:12.922636 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d6eccbf5-da5b-44a8-8b81-662e87d91faa tempest-GroupsTest-1997969427 None] Create group completed successfully. Dec 11 21:01:13.480107 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-27571857-c731-4762-aef1-fd3d136c1e40 tempest-AttachVolumeTestJSON-496084914 None] Lock "b'cinder-6d218a8d-14e8-4548-bd7c-d1dc9448b64d-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:01:13.536646 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-27571857-c731-4762-aef1-fd3d136c1e40 tempest-AttachVolumeTestJSON-496084914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:13.643457 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-27571857-c731-4762-aef1-fd3d136c1e40 tempest-AttachVolumeTestJSON-496084914 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:01:13.643918 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-27571857-c731-4762-aef1-fd3d136c1e40 tempest-AttachVolumeTestJSON-496084914 None] Volume volume-6d218a8d-14e8-4548-bd7c-d1dc9448b64d is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:01:13.652806 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-27571857-c731-4762-aef1-fd3d136c1e40 tempest-AttachVolumeTestJSON-496084914 None] deleting rbd volume volume-6d218a8d-14e8-4548-bd7c-d1dc9448b64d {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:01:14.065648 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ba3552ce-e779-48bb-8bda-6281eba9c3ea tempest-GroupsTest-1997969427 None] Group tempest-Group2-1699332207: creating Dec 11 21:01:14.104433 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ba3552ce-e779-48bb-8bda-6281eba9c3ea tempest-GroupsTest-1997969427 None] Group tempest-Group2-1699332207: created successfully Dec 11 21:01:14.116206 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ba3552ce-e779-48bb-8bda-6281eba9c3ea tempest-GroupsTest-1997969427 None] Create group completed successfully. Dec 11 21:01:14.137761 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-27571857-c731-4762-aef1-fd3d136c1e40 tempest-AttachVolumeTestJSON-496084914 None] Created reservations ['aae082e7-e913-4c09-8a7f-74f833900d29', '7ba2cc95-189d-4167-8c79-d962a1035343', '7fab2162-4b44-4401-ab18-6b6ab4f0a5aa', '949d78f7-bc5b-491e-adc3-c3fdffe5a1d8'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:01:14.201838 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-27571857-c731-4762-aef1-fd3d136c1e40 tempest-AttachVolumeTestJSON-496084914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:14.270655 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-27571857-c731-4762-aef1-fd3d136c1e40 tempest-AttachVolumeTestJSON-496084914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:14.323567 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-27571857-c731-4762-aef1-fd3d136c1e40 tempest-AttachVolumeTestJSON-496084914 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:01:14.329035 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-27571857-c731-4762-aef1-fd3d136c1e40 tempest-AttachVolumeTestJSON-496084914 None] Deleted volume successfully. Dec 11 21:01:14.352163 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-27571857-c731-4762-aef1-fd3d136c1e40 tempest-AttachVolumeTestJSON-496084914 None] Lock "b'cinder-6d218a8d-14e8-4548-bd7c-d1dc9448b64d-delete_volume'" released by "delete_volume" :: held 0.872s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:01:14.705221 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-67053e10-5f96-4cbe-a91c-c28a447cd7d0 tempest-AttachVolumeTestJSON-496084914 None] Lock "b'cinder-4b0f1f89-d730-4940-bf8e-78b633d9c4f1-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:01:14.751674 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-67053e10-5f96-4cbe-a91c-c28a447cd7d0 tempest-AttachVolumeTestJSON-496084914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:14.851803 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-67053e10-5f96-4cbe-a91c-c28a447cd7d0 tempest-AttachVolumeTestJSON-496084914 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:01:14.852629 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-67053e10-5f96-4cbe-a91c-c28a447cd7d0 tempest-AttachVolumeTestJSON-496084914 None] Volume volume-4b0f1f89-d730-4940-bf8e-78b633d9c4f1 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:01:14.862846 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-67053e10-5f96-4cbe-a91c-c28a447cd7d0 tempest-AttachVolumeTestJSON-496084914 None] deleting rbd volume volume-4b0f1f89-d730-4940-bf8e-78b633d9c4f1 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:01:15.317795 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-67053e10-5f96-4cbe-a91c-c28a447cd7d0 tempest-AttachVolumeTestJSON-496084914 None] Created reservations ['280c3c22-ae14-4d19-933e-c42cb46ec631', '926d88d7-af96-4631-b210-e73211a9b17f', 'cd1ab81e-72bf-43f5-85e2-6d332cbe474e', '3a32285d-c66d-4e5e-80fa-a4f644bf20ec'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:01:15.408547 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-67053e10-5f96-4cbe-a91c-c28a447cd7d0 tempest-AttachVolumeTestJSON-496084914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:15.508730 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-67053e10-5f96-4cbe-a91c-c28a447cd7d0 tempest-AttachVolumeTestJSON-496084914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:15.593373 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-67053e10-5f96-4cbe-a91c-c28a447cd7d0 tempest-AttachVolumeTestJSON-496084914 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:01:15.601507 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-67053e10-5f96-4cbe-a91c-c28a447cd7d0 tempest-AttachVolumeTestJSON-496084914 None] Deleted volume successfully. Dec 11 21:01:15.622867 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-67053e10-5f96-4cbe-a91c-c28a447cd7d0 tempest-AttachVolumeTestJSON-496084914 None] Lock "b'cinder-4b0f1f89-d730-4940-bf8e-78b633d9c4f1-delete_volume'" released by "delete_volume" :: held 0.918s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:01:15.998738 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:01:16.007381 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:01:16.008113 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:01:16.056249 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Flow 'volume_create_manager' (66f88bc7-c320-4fe0-b3f6-9e0fc83bfb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:01:16.060468 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e03c492-0faa-4724-8a4a-91021637f4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:16.122776 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:01:16.153384 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-52a6e604-3a3c-4fc5-8797-ef9547626682 tempest-AttachVolumeTestJSON-496084914 None] Lock "b'cinder-f8896d9b-d453-458b-9137-4b5e37666eb4-delete_volume'" acquired by "delete_volume" :: waited 0.052s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:01:16.199132 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e03c492-0faa-4724-8a4a-91021637f4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2034399379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0466b59d-16f3-4595-a02f-2847d0e46780,host='ncdv-master-1@ceph#ceph',id=f3aa66d8-3914-45b3-85b3-7b4d64f52c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8492baccab4bd9b650ec4efa7299b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:01:16Z,use_quota=True,user_id='ce81114791e64c6b845d419ef90cc52c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317c0c8c-2617-43fc-9040-c9d6593a3d29),volume_type_id=317c0c8c-2617-43fc-9040-c9d6593a3d29)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:16.202191 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef07558-f787-4a80-bf5f-1e31f46af3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:16.204709 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef07558-f787-4a80-bf5f-1e31f46af3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:16.207748 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a96585c-71d3-4dcd-87ef-33bb0d3bc4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:16.210824 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a96585c-71d3-4dcd-87ef-33bb0d3bc4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3aa66d8-3914-45b3-85b3-7b4d64f52c23', 'volume_name': 'volume-f3aa66d8-3914-45b3-85b3-7b4d64f52c23', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:16.213750 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243457ab-bd3a-43e7-9572-d94d9e45bbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:16.216737 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243457ab-bd3a-43e7-9572-d94d9e45bbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:16.222847 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07045a28-49ce-405e-a6dd-c9bda4e1c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:16.327639 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-52a6e604-3a3c-4fc5-8797-ef9547626682 tempest-AttachVolumeTestJSON-496084914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:16.400762 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-52a6e604-3a3c-4fc5-8797-ef9547626682 tempest-AttachVolumeTestJSON-496084914 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:01:16.401278 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-52a6e604-3a3c-4fc5-8797-ef9547626682 tempest-AttachVolumeTestJSON-496084914 None] Volume volume-f8896d9b-d453-458b-9137-4b5e37666eb4 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:01:16.411399 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-52a6e604-3a3c-4fc5-8797-ef9547626682 tempest-AttachVolumeTestJSON-496084914 None] deleting rbd volume volume-f8896d9b-d453-458b-9137-4b5e37666eb4 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:01:16.416183 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Volume f3aa66d8-3914-45b3-85b3-7b4d64f52c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3aa66d8-3914-45b3-85b3-7b4d64f52c23', 'volume_size': 1} Dec 11 21:01:16.416664 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] creating volume 'volume-f3aa66d8-3914-45b3-85b3-7b4d64f52c23' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:01:16.417563 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:16.558801 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] extra_specs: {} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:01:16.559178 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] extra_specs: {} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:01:16.562346 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07045a28-49ce-405e-a6dd-c9bda4e1c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3aa66d8-3914-45b3-85b3-7b4d64f52c23', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:16.567981 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379facf9-f2e2-414f-af37-ff1966896cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:16.587021 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Volume volume-f3aa66d8-3914-45b3-85b3-7b4d64f52c23 (f3aa66d8-3914-45b3-85b3-7b4d64f52c23): created successfully Dec 11 21:01:16.589433 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379facf9-f2e2-414f-af37-ff1966896cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:16.600159 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Flow 'volume_create_manager' (66f88bc7-c320-4fe0-b3f6-9e0fc83bfb49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:01:16.615069 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-acdf316c-a9be-40c2-913f-af6f25b5bc0d tempest-GroupsTest-1997969427 None] Created volume successfully. Dec 11 21:01:16.862123 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-52a6e604-3a3c-4fc5-8797-ef9547626682 tempest-AttachVolumeTestJSON-496084914 None] Created reservations ['48889cef-a8a2-4997-b8b1-46710a5c81a7', '7919476c-2fea-4ffc-936b-25db5658f053', 'df25c0ce-659d-47ec-a172-9b58affa3d78', 'ce274d37-3c3a-44fe-825c-1c8d89c6862a'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:01:16.952526 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-52a6e604-3a3c-4fc5-8797-ef9547626682 tempest-AttachVolumeTestJSON-496084914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:17.048629 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-52a6e604-3a3c-4fc5-8797-ef9547626682 tempest-AttachVolumeTestJSON-496084914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:17.127637 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-52a6e604-3a3c-4fc5-8797-ef9547626682 tempest-AttachVolumeTestJSON-496084914 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:01:17.133095 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-52a6e604-3a3c-4fc5-8797-ef9547626682 tempest-AttachVolumeTestJSON-496084914 None] Deleted volume successfully. Dec 11 21:01:17.162776 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-52a6e604-3a3c-4fc5-8797-ef9547626682 tempest-AttachVolumeTestJSON-496084914 None] Lock "b'cinder-f8896d9b-d453-458b-9137-4b5e37666eb4-delete_volume'" released by "delete_volume" :: held 1.009s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:01:18.046020 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-49d06c05-646d-4694-8a69-47f9b041b376 tempest-GroupsTest-1997969427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:18.144099 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-49d06c05-646d-4694-8a69-47f9b041b376 tempest-GroupsTest-1997969427 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:01:18.144727 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-49d06c05-646d-4694-8a69-47f9b041b376 tempest-GroupsTest-1997969427 None] Volume volume-f3aa66d8-3914-45b3-85b3-7b4d64f52c23 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:01:18.159796 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-49d06c05-646d-4694-8a69-47f9b041b376 tempest-GroupsTest-1997969427 None] deleting rbd volume volume-f3aa66d8-3914-45b3-85b3-7b4d64f52c23 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:01:18.683026 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-49d06c05-646d-4694-8a69-47f9b041b376 tempest-GroupsTest-1997969427 None] Created reservations ['f7a37e65-bfb2-4372-ba20-1e5b6654c05e'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:01:18.704149 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-49d06c05-646d-4694-8a69-47f9b041b376 tempest-GroupsTest-1997969427 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1769360929 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1769360929, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:01:18.706759 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-49d06c05-646d-4694-8a69-47f9b041b376 tempest-GroupsTest-1997969427 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1769360929 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1769360929, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:01:18.723145 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-49d06c05-646d-4694-8a69-47f9b041b376 tempest-GroupsTest-1997969427 None] Created reservations ['2c90fffd-bcfc-47cb-8b38-ffa7a356a289', '03b7491e-fd06-450f-bcd7-e009a1b498fc', '87f938f7-e3fc-4b55-b8e8-b567c5124eea', 'c97a9d3b-ed44-4293-a84e-dcf240ae224c'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:01:18.837831 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-49d06c05-646d-4694-8a69-47f9b041b376 tempest-GroupsTest-1997969427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:18.877224 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-49d06c05-646d-4694-8a69-47f9b041b376 tempest-GroupsTest-1997969427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:18.924767 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-49d06c05-646d-4694-8a69-47f9b041b376 tempest-GroupsTest-1997969427 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:01:18.929647 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-49d06c05-646d-4694-8a69-47f9b041b376 tempest-GroupsTest-1997969427 None] Delete group completed successfully. Dec 11 21:01:19.379427 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-7dc033f6-6a49-46d6-a43c-da6f9cb3bb82 tempest-GroupsTest-1997969427 None] Created reservations ['245cfa4a-8e87-4e0c-8fe6-105a6f9227e0'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:01:19.428257 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7dc033f6-6a49-46d6-a43c-da6f9cb3bb82 tempest-GroupsTest-1997969427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:19.487126 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7dc033f6-6a49-46d6-a43c-da6f9cb3bb82 tempest-GroupsTest-1997969427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:19.540956 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7dc033f6-6a49-46d6-a43c-da6f9cb3bb82 tempest-GroupsTest-1997969427 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:01:19.545212 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7dc033f6-6a49-46d6-a43c-da6f9cb3bb82 tempest-GroupsTest-1997969427 None] Delete group completed successfully. Dec 11 21:01:21.072369 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-6a52d5d2-ce42-4f72-b37b-cfb19538434b tempest-GroupsTest-1997969427 None] Group tempest-GroupsTest-Group-1340791246: creating Dec 11 21:01:21.100790 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-6a52d5d2-ce42-4f72-b37b-cfb19538434b tempest-GroupsTest-1997969427 None] Group tempest-GroupsTest-Group-1340791246: created successfully Dec 11 21:01:21.116169 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-6a52d5d2-ce42-4f72-b37b-cfb19538434b tempest-GroupsTest-1997969427 None] Create group completed successfully. Dec 11 21:01:22.885632 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:01:22.897553 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:01:22.898880 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:01:22.935031 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Flow 'volume_create_manager' (3bf5114d-2302-420a-8711-2bdeaed58c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:01:22.943118 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff5ad48-472c-4f2d-9a97-1307e19cff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:22.969312 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:01:23.013480 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff5ad48-472c-4f2d-9a97-1307e19cff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-883350163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2402668a-35a2-41b1-969f-835effd4afa8,host='ncdv-master-1@ceph#ceph',id=d404bf6c-9ef0-4376-bc54-fe7e2d8f9b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8492baccab4bd9b650ec4efa7299b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:01:23Z,use_quota=True,user_id='ce81114791e64c6b845d419ef90cc52c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e32cea9d-ebc3-4a41-a896-cb7d1fee1dbf),volume_type_id=e32cea9d-ebc3-4a41-a896-cb7d1fee1dbf)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:23.021015 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954c5475-35b4-411d-8a79-f20761868008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:23.024160 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954c5475-35b4-411d-8a79-f20761868008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:23.026714 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444eb7ca-f979-4b91-898a-2bb2291f4bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:23.040462 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444eb7ca-f979-4b91-898a-2bb2291f4bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd404bf6c-9ef0-4376-bc54-fe7e2d8f9b55', 'volume_name': 'volume-d404bf6c-9ef0-4376-bc54-fe7e2d8f9b55', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:23.047383 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7ea7bf-724c-4aef-9cc4-71b9963a7852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:23.052598 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7ea7bf-724c-4aef-9cc4-71b9963a7852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:23.053414 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9f327c-30b8-401f-a2ca-77a5c9cbed59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:23.077811 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Volume d404bf6c-9ef0-4376-bc54-fe7e2d8f9b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d404bf6c-9ef0-4376-bc54-fe7e2d8f9b55', 'volume_size': 1} Dec 11 21:01:23.078297 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] creating volume 'volume-d404bf6c-9ef0-4376-bc54-fe7e2d8f9b55' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:01:23.080650 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:23.178714 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] extra_specs: {} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:01:23.179088 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] extra_specs: {} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:01:23.181184 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9f327c-30b8-401f-a2ca-77a5c9cbed59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d404bf6c-9ef0-4376-bc54-fe7e2d8f9b55', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:23.185487 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4b4d21-1cb4-4c57-a73e-a7ce18e8a2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:23.198718 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Volume volume-d404bf6c-9ef0-4376-bc54-fe7e2d8f9b55 (d404bf6c-9ef0-4376-bc54-fe7e2d8f9b55): created successfully Dec 11 21:01:23.203867 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4b4d21-1cb4-4c57-a73e-a7ce18e8a2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:23.208928 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Flow 'volume_create_manager' (3bf5114d-2302-420a-8711-2bdeaed58c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:01:23.223381 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d1a6ddcf-98a1-459a-afce-8ffbea3ce587 tempest-GroupsTest-1997969427 None] Created volume successfully. Dec 11 21:01:24.627944 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:01:24.632010 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:01:24.634123 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:01:24.678990 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Flow 'volume_create_manager' (d08f1dae-68a1-42d0-8a71-4abc919e089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:01:24.713618 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (887e0961-3e38-419a-9be8-5a2f6b285792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:24.728498 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:01:24.781095 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (887e0961-3e38-419a-9be8-5a2f6b285792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1127239712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2402668a-35a2-41b1-969f-835effd4afa8,host='ncdv-master-1@ceph#ceph',id=87ebbf12-968b-4e2d-9439-793d2a609cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8492baccab4bd9b650ec4efa7299b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:01:25Z,use_quota=True,user_id='ce81114791e64c6b845d419ef90cc52c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e32cea9d-ebc3-4a41-a896-cb7d1fee1dbf),volume_type_id=e32cea9d-ebc3-4a41-a896-cb7d1fee1dbf)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:24.795124 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e774705b-11c8-4a0c-aa4a-71331417f58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:24.801095 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e774705b-11c8-4a0c-aa4a-71331417f58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:24.806807 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f835b792-0132-4273-9aa6-166143c750b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:24.812282 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f835b792-0132-4273-9aa6-166143c750b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ebbf12-968b-4e2d-9439-793d2a609cf8', 'volume_name': 'volume-87ebbf12-968b-4e2d-9439-793d2a609cf8', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:24.817355 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56adffe3-6c90-4b32-8450-657afcf950de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:24.820083 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56adffe3-6c90-4b32-8450-657afcf950de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:24.823676 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc5528a-5e1a-4cb4-97b8-003a327c5e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:24.844197 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Volume 87ebbf12-968b-4e2d-9439-793d2a609cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ebbf12-968b-4e2d-9439-793d2a609cf8', 'volume_size': 1} Dec 11 21:01:24.844983 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] creating volume 'volume-87ebbf12-968b-4e2d-9439-793d2a609cf8' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:01:24.846428 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:24.980271 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] extra_specs: {} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:01:24.981342 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] extra_specs: {} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:01:24.984645 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc5528a-5e1a-4cb4-97b8-003a327c5e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ebbf12-968b-4e2d-9439-793d2a609cf8', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:24.987997 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e90611c-bf38-458f-8984-a9f50ad6e19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:24.998681 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Volume volume-87ebbf12-968b-4e2d-9439-793d2a609cf8 (87ebbf12-968b-4e2d-9439-793d2a609cf8): created successfully Dec 11 21:01:25.000984 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e90611c-bf38-458f-8984-a9f50ad6e19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:25.006384 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Flow 'volume_create_manager' (d08f1dae-68a1-42d0-8a71-4abc919e089b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:01:25.022089 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f15ad1e1-4cef-4b87-b33f-074bbcb0d37e tempest-GroupsTest-1997969427 None] Created volume successfully. Dec 11 21:01:26.025314 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-5119df26-6831-4b37-b528-4bfe117791d5 tempest-GroupsTest-1997969427 None] Update group completed successfully. Dec 11 21:01:27.414512 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-e94d15a5-52b8-4273-8dc7-97bd43cc0c80 tempest-GroupsTest-1997969427 None] Update group completed successfully. Dec 11 21:01:28.949104 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:29.033986 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:01:29.035051 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] Volume volume-87ebbf12-968b-4e2d-9439-793d2a609cf8 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:01:29.049079 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] deleting rbd volume volume-87ebbf12-968b-4e2d-9439-793d2a609cf8 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:01:29.428442 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:29.517152 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:01:29.517771 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] Volume volume-d404bf6c-9ef0-4376-bc54-fe7e2d8f9b55 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:01:29.534973 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] deleting rbd volume volume-d404bf6c-9ef0-4376-bc54-fe7e2d8f9b55 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:01:30.124642 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] Created reservations ['b76520ab-efb1-4b47-ba8b-e8cf4e09cbc1'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:01:30.171663 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-469338452 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-469338452, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:01:30.173545 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-469338452 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-469338452, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:01:30.201980 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] Created reservations ['ffee71ac-9aa4-4628-bffb-715dfe7aa99d', '5f280057-5f76-47fa-8018-90c15647f319', '9edbb9f3-da35-4e11-ac34-6e9832642deb', '78cee235-6e42-47b4-a5da-4cf3898a5683'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:01:30.335412 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] Created reservations ['397f4f73-0afb-4536-aee1-2d9bf6e4a0c1', '001dc477-d378-479d-ab4c-0ff73338252e', '4a891f88-76ab-49e5-bf8a-273ff7fdb2d4', 'd5445877-99e8-40f3-b6aa-a81285e651d2'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:01:30.441847 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:30.507001 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:30.576464 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:01:30.581958 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9daba1da-888f-43f2-8ba0-8759a4dea2dc tempest-GroupsTest-1997969427 None] Delete group completed successfully. Dec 11 21:01:45.142351 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:01:45.147351 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:01:45.147792 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:01:45.161239 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Flow 'volume_create_manager' (5e55065a-023a-439f-a962-c3fa63e3f609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:01:45.164580 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7202fe-0fcb-4f48-8767-9548a47c585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:45.173711 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:01:45.187934 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7202fe-0fcb-4f48-8767-9548a47c585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1800310228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=25698830-0c8e-4474-8c07-bed574669327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03f32a2164d4b5397969691eda9376f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:01:45Z,use_quota=True,user_id='b76e08b610c34aa4ace578ad369a57af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:45.206756 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99fb4445-9c10-4ca1-aa92-d6de26793b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:45.214505 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99fb4445-9c10-4ca1-aa92-d6de26793b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:45.221481 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c42c19-6a86-4d81-b25d-828de9a6fa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:45.241298 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c42c19-6a86-4d81-b25d-828de9a6fa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25698830-0c8e-4474-8c07-bed574669327', 'volume_name': 'volume-25698830-0c8e-4474-8c07-bed574669327', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:45.246098 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40eb545c-d4ec-4b40-8098-fef26e0d1fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:45.249638 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40eb545c-d4ec-4b40-8098-fef26e0d1fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:45.254510 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7de7f39-4be0-4340-9303-6887d082118c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:45.255801 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Volume 25698830-0c8e-4474-8c07-bed574669327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25698830-0c8e-4474-8c07-bed574669327', 'volume_size': 1} Dec 11 21:01:45.256451 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] creating volume 'volume-25698830-0c8e-4474-8c07-bed574669327' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:01:45.257663 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:45.426234 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:01:45.427115 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:01:45.431336 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7de7f39-4be0-4340-9303-6887d082118c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25698830-0c8e-4474-8c07-bed574669327', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:45.435494 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb490b64-b550-458c-b81b-246f7a57e0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:45.459420 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Volume volume-25698830-0c8e-4474-8c07-bed574669327 (25698830-0c8e-4474-8c07-bed574669327): created successfully Dec 11 21:01:45.461836 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb490b64-b550-458c-b81b-246f7a57e0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:45.466695 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Flow 'volume_create_manager' (5e55065a-023a-439f-a962-c3fa63e3f609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:01:45.491144 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-91ddddc0-a2bf-4868-ab55-4d9c08f2b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Created volume successfully. Dec 11 21:01:46.512550 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eb29b50a-b2ed-446e-891c-8c45f1a9e902 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:47.686616 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-eb29b50a-b2ed-446e-891c-8c45f1a9e902 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Create snapshot completed successfully Dec 11 21:01:49.274237 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-1be4e225-e11b-4ac7-a9bd-276f659f1261 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Lock "b'cinder-d51a598d-90ad-44fe-8bc0-5e6111d43628-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:01:49.276455 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1be4e225-e11b-4ac7-a9bd-276f659f1261 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:49.771510 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-1be4e225-e11b-4ac7-a9bd-276f659f1261 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:01:49.815323 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-1be4e225-e11b-4ac7-a9bd-276f659f1261 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Created reservations ['3d85dbf2-b00d-408a-aecc-34b333f515dd', '5b3641c8-af1e-40b7-89da-557b7c32b6cb', '9e6983e0-2e52-43b2-817d-05e0287f351c', 'de9586e2-a8b1-4cb2-89f8-3a57d6eff550'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:01:49.902710 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1be4e225-e11b-4ac7-a9bd-276f659f1261 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Delete snapshot completed successfully. Dec 11 21:01:49.911444 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-1be4e225-e11b-4ac7-a9bd-276f659f1261 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Lock "b'cinder-d51a598d-90ad-44fe-8bc0-5e6111d43628-delete_snapshot'" released by "delete_snapshot" :: held 0.639s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:01:50.496980 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8328c3af-1c41-44f1-b888-f0f6c9287588 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Lock "b'cinder-25698830-0c8e-4474-8c07-bed574669327-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:01:50.572485 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8328c3af-1c41-44f1-b888-f0f6c9287588 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:50.698205 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8328c3af-1c41-44f1-b888-f0f6c9287588 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:01:50.699511 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8328c3af-1c41-44f1-b888-f0f6c9287588 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Volume volume-25698830-0c8e-4474-8c07-bed574669327 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:01:50.715951 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8328c3af-1c41-44f1-b888-f0f6c9287588 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] deleting rbd volume volume-25698830-0c8e-4474-8c07-bed574669327 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:01:51.245406 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-8328c3af-1c41-44f1-b888-f0f6c9287588 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Created reservations ['ea45b5a5-5d97-403e-983d-8e7d06b75ba9', '15f05d7a-7a75-4595-8f89-fbd21ffd25d1', '841153cd-20df-4479-a6e6-d1f9a8bd1f8a', 'd6226f85-d68f-4776-97f4-0c88728c11c8'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:01:51.376402 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8328c3af-1c41-44f1-b888-f0f6c9287588 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:51.474404 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8328c3af-1c41-44f1-b888-f0f6c9287588 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:51.572577 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-8328c3af-1c41-44f1-b888-f0f6c9287588 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:01:51.577546 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8328c3af-1c41-44f1-b888-f0f6c9287588 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Deleted volume successfully. Dec 11 21:01:51.604371 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8328c3af-1c41-44f1-b888-f0f6c9287588 tempest-VolumeSnapshotQuotasNegativeTestJSON-1961858864 None] Lock "b'cinder-25698830-0c8e-4474-8c07-bed574669327-delete_volume'" released by "delete_volume" :: held 1.107s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:01:55.061257 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:01:55.061964 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:55.151558 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:55.214174 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:01:58.143789 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:01:58.148600 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:01:58.149356 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:01:58.185568 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Flow 'volume_create_manager' (99af9c68-dfaf-44ec-a391-7619c517f901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:01:58.196703 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c059eff8-3f7a-4dc8-83cf-424369f298c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:58.212245 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:01:58.230630 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c059eff8-3f7a-4dc8-83cf-424369f298c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1383030102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f014d858-0dfb-4678-ba61-f58553035d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635bfc9a6fa94d27bd749ecae12305d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:01:58Z,use_quota=True,user_id='8b75d214d8f34a4f9f0333c863f55d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63081374-7c2f-4105-bb57-08c7a66fd118),volume_type_id=63081374-7c2f-4105-bb57-08c7a66fd118)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:58.259436 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcfc56d-58a5-47f4-bdd8-c725023f81b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:58.261914 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcfc56d-58a5-47f4-bdd8-c725023f81b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:58.264349 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b96ba9-b014-4d5f-8ee6-f003bb6e3d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:58.276512 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b96ba9-b014-4d5f-8ee6-f003bb6e3d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f014d858-0dfb-4678-ba61-f58553035d8f', 'volume_name': 'volume-f014d858-0dfb-4678-ba61-f58553035d8f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:58.289686 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18745225-72e2-4fb5-94f4-8059064afb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:58.292323 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18745225-72e2-4fb5-94f4-8059064afb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:58.294812 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead21ed1-b4f9-4a8c-841b-a5f3eceabb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:58.295749 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Volume f014d858-0dfb-4678-ba61-f58553035d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f014d858-0dfb-4678-ba61-f58553035d8f', 'volume_size': 1} Dec 11 21:01:58.296326 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] creating volume 'volume-f014d858-0dfb-4678-ba61-f58553035d8f' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:01:58.297909 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:58.464498 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:01:58.465100 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:01:58.467407 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead21ed1-b4f9-4a8c-841b-a5f3eceabb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f014d858-0dfb-4678-ba61-f58553035d8f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:58.470540 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0697eaaf-e0cb-402a-80eb-07ce177f0c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:01:58.490533 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Volume volume-f014d858-0dfb-4678-ba61-f58553035d8f (f014d858-0dfb-4678-ba61-f58553035d8f): created successfully Dec 11 21:01:58.492670 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0697eaaf-e0cb-402a-80eb-07ce177f0c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:01:58.495906 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Flow 'volume_create_manager' (99af9c68-dfaf-44ec-a391-7619c517f901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:01:58.520156 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8ab88749-f74d-4b73-8460-52dc2ba835e6 tempest-VolumeTypesTest-1140104599 None] Created volume successfully. Dec 11 21:01:59.651735 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-732fc222-17cf-42c2-ad18-6ee11ed223ce tempest-VolumeTypesTest-1140104599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:59.707202 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-732fc222-17cf-42c2-ad18-6ee11ed223ce tempest-VolumeTypesTest-1140104599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:01:59.772843 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-732fc222-17cf-42c2-ad18-6ee11ed223ce tempest-VolumeTypesTest-1140104599 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:01:59.778799 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-732fc222-17cf-42c2-ad18-6ee11ed223ce tempest-VolumeTypesTest-1140104599 None] Retype volume completed successfully. Dec 11 21:02:02.018216 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] Lock "b'cinder-f014d858-0dfb-4678-ba61-f58553035d8f-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:02:02.125567 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:02.205345 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:02:02.205770 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] Volume volume-f014d858-0dfb-4678-ba61-f58553035d8f is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:02:02.220889 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] deleting rbd volume volume-f014d858-0dfb-4678-ba61-f58553035d8f {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:02:02.708723 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-2098927173 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-2098927173, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:02:02.709717 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-2098927173 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-2098927173, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:02:02.757223 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] Created reservations ['e63d792c-5f0e-407d-8ccc-032c30de703c', '94c6b249-558c-4b50-9cb9-25a665882ad6', '620e24b9-7859-4e0c-b01a-461776d49561', 'e9da5969-2a57-4c4f-b530-333a5163c663'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:02:02.878533 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:02.941659 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:02.998969 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:02:03.011370 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] Deleted volume successfully. Dec 11 21:02:03.032013 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7ab6d3be-79c5-4a49-9a54-7c6540c26659 tempest-VolumeTypesTest-1140104599 None] Lock "b'cinder-f014d858-0dfb-4678-ba61-f58553035d8f-delete_volume'" released by "delete_volume" :: held 1.015s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:02:18.723663 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:02:18.754899 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:02:18.756245 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:02:18.808961 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Flow 'volume_create_manager' (4bb1566b-9c4b-4f2b-9e04-e6e8ead3b17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:18.817008 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d3f580-ac34-43f5-bd46-8e52021e4389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:18.828153 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:02:18.857463 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d3f580-ac34-43f5-bd46-8e52021e4389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-324078182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8be8b2a0-dcff-46c2-93a3-a620aea00b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85318641ba794d7b8c5c07b5177e5315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:02:19Z,use_quota=True,user_id='d7e5dc4fd713450194d44d8fa41158cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03eac2e0-25c9-4d72-95b0-358404e459e3),volume_type_id=03eac2e0-25c9-4d72-95b0-358404e459e3)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:18.871837 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f73ab31-bf07-4660-ab96-08756f683f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:18.884427 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f73ab31-bf07-4660-ab96-08756f683f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:18.892249 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21bbc2ee-0292-432f-8baf-767d3cd4d4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:18.894698 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21bbc2ee-0292-432f-8baf-767d3cd4d4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be8b2a0-dcff-46c2-93a3-a620aea00b8c', 'volume_name': 'volume-8be8b2a0-dcff-46c2-93a3-a620aea00b8c', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:18.908575 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f96896-f7f6-483e-b06a-d98ec7ebdafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:18.913409 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f96896-f7f6-483e-b06a-d98ec7ebdafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:18.916732 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74d15fa-a0bb-43a2-bd7a-f536894c0aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:18.918757 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Volume 8be8b2a0-dcff-46c2-93a3-a620aea00b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be8b2a0-dcff-46c2-93a3-a620aea00b8c', 'volume_size': 1} Dec 11 21:02:18.919591 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] creating volume 'volume-8be8b2a0-dcff-46c2-93a3-a620aea00b8c' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:02:18.921562 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:19.055613 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] extra_specs: {} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:02:19.056601 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] extra_specs: {} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:02:19.059041 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74d15fa-a0bb-43a2-bd7a-f536894c0aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be8b2a0-dcff-46c2-93a3-a620aea00b8c', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:19.061340 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043a8b63-ca77-448b-90b0-468568ce80f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:19.079104 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Volume volume-8be8b2a0-dcff-46c2-93a3-a620aea00b8c (8be8b2a0-dcff-46c2-93a3-a620aea00b8c): created successfully Dec 11 21:02:19.081296 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043a8b63-ca77-448b-90b0-468568ce80f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:19.085083 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Flow 'volume_create_manager' (4bb1566b-9c4b-4f2b-9e04-e6e8ead3b17a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:19.098394 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-6e2dce60-1bee-4975-8743-e5e3efb49150 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Created volume successfully. Dec 11 21:02:20.145021 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-44f5b1cd-02bb-4705-9838-a0fc11521ae8 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:20.223412 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-44f5b1cd-02bb-4705-9838-a0fc11521ae8 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:20.293204 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-44f5b1cd-02bb-4705-9838-a0fc11521ae8 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:02:20.300048 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-44f5b1cd-02bb-4705-9838-a0fc11521ae8 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Retype volume completed successfully. Dec 11 21:02:21.414811 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Lock "b'cinder-8be8b2a0-dcff-46c2-93a3-a620aea00b8c-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:02:21.475292 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:21.556460 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:02:21.557136 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Volume volume-8be8b2a0-dcff-46c2-93a3-a620aea00b8c is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:02:21.572175 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] deleting rbd volume volume-8be8b2a0-dcff-46c2-93a3-a620aea00b8c {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:02:21.928527 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:02:21.930054 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:02:21.949658 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Created reservations ['fda2bcd2-4779-4d25-8396-c90c9f595e23', '6047a813-ff32-4a44-9abf-fc602959d6ba', '2ca3729d-c732-4639-b8a7-dcc410b83f5c', 'ec71c93c-fb19-4ff6-84ee-ae79b4dea031'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:02:22.014900 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:22.059312 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:22.127826 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:02:22.132853 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Deleted volume successfully. Dec 11 21:02:22.145982 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-50cc9b91-e52e-4284-a031-4d6265bc6347 tempest-VolumeRetypeWithoutMigrationTest-1891383966 None] Lock "b'cinder-8be8b2a0-dcff-46c2-93a3-a620aea00b8c-delete_volume'" released by "delete_volume" :: held 0.731s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:02:27.495100 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:02:27.498424 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:02:27.499464 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:02:27.552292 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Flow 'volume_create_manager' (709047db-692a-4539-b386-de500c600509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:27.564407 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e81f56d-a289-4ba7-a52f-b3e867a9f3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:27.582934 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:02:27.618441 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e81f56d-a289-4ba7-a52f-b3e867a9f3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1234747141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c22fef7f-8239-477a-b82d-59ecc34c91bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0391c4e11bf243febd9a93713c1b4ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:02:27Z,use_quota=True,user_id='b91922373b3f47f68bf2bb8a2b8bb333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:27.625134 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fd0765-5d24-40a9-ad25-8500751dc2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:27.630258 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fd0765-5d24-40a9-ad25-8500751dc2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:27.636146 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d091dead-1fd9-4b96-9201-2dc8199119fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:27.641717 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d091dead-1fd9-4b96-9201-2dc8199119fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c22fef7f-8239-477a-b82d-59ecc34c91bf', 'volume_name': 'volume-c22fef7f-8239-477a-b82d-59ecc34c91bf', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:27.649547 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf14fc8-c2f3-417d-b188-74f665dcd10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:27.656233 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf14fc8-c2f3-417d-b188-74f665dcd10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:27.662256 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa144375-192e-4ed1-afb9-2310f6bf446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:27.664822 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Volume c22fef7f-8239-477a-b82d-59ecc34c91bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c22fef7f-8239-477a-b82d-59ecc34c91bf', 'volume_size': 1} Dec 11 21:02:27.666789 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] creating volume 'volume-c22fef7f-8239-477a-b82d-59ecc34c91bf' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:02:27.671042 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:27.821566 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:02:27.822376 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:02:27.824843 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa144375-192e-4ed1-afb9-2310f6bf446a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c22fef7f-8239-477a-b82d-59ecc34c91bf', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:27.827860 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d7ab79-a631-4320-b232-ed62485e4516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:27.844413 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Volume volume-c22fef7f-8239-477a-b82d-59ecc34c91bf (c22fef7f-8239-477a-b82d-59ecc34c91bf): created successfully Dec 11 21:02:27.848386 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d7ab79-a631-4320-b232-ed62485e4516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:27.854214 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Flow 'volume_create_manager' (709047db-692a-4539-b386-de500c600509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:27.873066 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-6a569263-6342-4a6d-90c7-83540f6aaa9d tempest-VolumesActionsTest-2028875331 None] Created volume successfully. Dec 11 21:02:28.604304 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-0799c820-8454-4aad-a405-839f493820b6 tempest-VolumesActionsTest-2028875331 None] Lock "b'cinder-c22fef7f-8239-477a-b82d-59ecc34c91bf'" acquired by "attach_volume" :: waited 0.024s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:02:28.670355 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-0799c820-8454-4aad-a405-839f493820b6 tempest-VolumesActionsTest-2028875331 None] Attaching volume c22fef7f-8239-477a-b82d-59ecc34c91bf to instance 8257e3c8-12ee-4d48-aaa7-4d9ec6c3e4cd at mountpoint /dev/sdb on host None. Dec 11 21:02:28.701429 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-0799c820-8454-4aad-a405-839f493820b6 tempest-VolumesActionsTest-2028875331 None] Attach volume completed successfully. Dec 11 21:02:28.709207 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-0799c820-8454-4aad-a405-839f493820b6 tempest-VolumesActionsTest-2028875331 None] Lock "b'cinder-c22fef7f-8239-477a-b82d-59ecc34c91bf'" released by "attach_volume" :: held 0.105s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:02:29.617679 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-376e7aa7-22b8-4742-bcee-3647d8cf2b0f tempest-VolumesActionsTest-1603680914 None] Terminate volume connection completed successfully. Dec 11 21:02:29.684907 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-376e7aa7-22b8-4742-bcee-3647d8cf2b0f tempest-VolumesActionsTest-1603680914 None] Lock "b'cinder-c22fef7f-8239-477a-b82d-59ecc34c91bf-detach_volume'" acquired by "detach_volume" :: waited 0.031s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:02:29.711693 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-376e7aa7-22b8-4742-bcee-3647d8cf2b0f tempest-VolumesActionsTest-1603680914 None] Detaching volume c22fef7f-8239-477a-b82d-59ecc34c91bf from instance 8257e3c8-12ee-4d48-aaa7-4d9ec6c3e4cd. Dec 11 21:02:29.777778 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-376e7aa7-22b8-4742-bcee-3647d8cf2b0f tempest-VolumesActionsTest-1603680914 None] Detach volume completed successfully. Dec 11 21:02:29.785619 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-376e7aa7-22b8-4742-bcee-3647d8cf2b0f tempest-VolumesActionsTest-1603680914 None] Lock "b'cinder-c22fef7f-8239-477a-b82d-59ecc34c91bf-detach_volume'" released by "detach_volume" :: held 0.101s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:02:30.044390 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-dfdaca26-41d0-4b80-9b68-1ba25212d076 tempest-VolumesActionsTest-2028875331 None] Lock "b'cinder-c22fef7f-8239-477a-b82d-59ecc34c91bf-detach_volume'" acquired by "detach_volume" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:02:30.045016 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-dfdaca26-41d0-4b80-9b68-1ba25212d076 tempest-VolumesActionsTest-2028875331 None] Volume detach called, but volume not attached. Dec 11 21:02:30.062571 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-dfdaca26-41d0-4b80-9b68-1ba25212d076 tempest-VolumesActionsTest-2028875331 None] Lock "b'cinder-c22fef7f-8239-477a-b82d-59ecc34c91bf-detach_volume'" released by "detach_volume" :: held 0.018s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:02:36.381606 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:02:36.389619 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:02:36.393823 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:02:36.433081 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Flow 'volume_create_manager' (0f0a5ca3-65e3-49f9-9f37-001174615b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:36.442991 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688af974-cf1b-4174-8a42-e456471fff66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:36.458207 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:02:36.492402 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688af974-cf1b-4174-8a42-e456471fff66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-333886792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b476a3b3-71ba-4fb2-becb-5c80cf6feb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0391c4e11bf243febd9a93713c1b4ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:02:36Z,use_quota=True,user_id='b91922373b3f47f68bf2bb8a2b8bb333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:36.512413 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea4cbcc-204a-47cc-a030-7128f6a62b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:36.524764 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea4cbcc-204a-47cc-a030-7128f6a62b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:36.532275 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d27d0b-6b29-40cf-9781-68f464d0869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:36.539105 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d27d0b-6b29-40cf-9781-68f464d0869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b476a3b3-71ba-4fb2-becb-5c80cf6feb15', 'volume_name': 'volume-b476a3b3-71ba-4fb2-becb-5c80cf6feb15', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:36.541464 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45023ce9-d37d-4ce3-b0bc-7adc57920894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:36.550305 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45023ce9-d37d-4ce3-b0bc-7adc57920894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:36.561555 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed615be-8c38-4b06-a10e-27574bfad353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:36.562458 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Volume b476a3b3-71ba-4fb2-becb-5c80cf6feb15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b476a3b3-71ba-4fb2-becb-5c80cf6feb15', 'volume_size': 1} Dec 11 21:02:36.562868 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] creating volume 'volume-b476a3b3-71ba-4fb2-becb-5c80cf6feb15' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:02:36.564249 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:36.735034 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:02:36.735858 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:02:36.738729 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed615be-8c38-4b06-a10e-27574bfad353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b476a3b3-71ba-4fb2-becb-5c80cf6feb15', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:36.741399 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee9c12b-ed93-4000-8c12-bfe81d11bea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:36.768341 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Volume volume-b476a3b3-71ba-4fb2-becb-5c80cf6feb15 (b476a3b3-71ba-4fb2-becb-5c80cf6feb15): created successfully Dec 11 21:02:36.777943 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee9c12b-ed93-4000-8c12-bfe81d11bea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:36.782117 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Flow 'volume_create_manager' (0f0a5ca3-65e3-49f9-9f37-001174615b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:36.797918 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4acfbf82-8b6b-4847-b791-a215f265d169 tempest-VolumesActionsTest-2028875331 None] Created volume successfully. Dec 11 21:02:37.189001 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:02:37.193462 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:02:37.194191 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:02:37.215794 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Flow 'volume_create_manager' (35fe8661-944d-42e2-b062-ce557d08210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:37.220778 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d7a728-509c-44bc-a837-104a28a30c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:37.229123 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:02:37.248201 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d7a728-509c-44bc-a837-104a28a30c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1021832043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4e91c29-493e-416d-a5d0-ccf25a2371f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308785d2f32842fc9a54131a10325012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:02:37Z,use_quota=True,user_id='dee2bfdd73f84a85b406972543c25f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:37.253766 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065bec98-bb25-48b5-96c1-015b1410d329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:37.256720 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065bec98-bb25-48b5-96c1-015b1410d329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:37.263304 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95d518c-b240-42ee-9ac3-24c24c29a3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:37.267181 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95d518c-b240-42ee-9ac3-24c24c29a3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e91c29-493e-416d-a5d0-ccf25a2371f2', 'volume_name': 'volume-f4e91c29-493e-416d-a5d0-ccf25a2371f2', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:37.272886 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b3b175-aefa-4684-a217-be3defc81919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:37.275944 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b3b175-aefa-4684-a217-be3defc81919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:37.280714 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d47d7eb-592e-4084-b74b-9f1d410c7f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:37.283718 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Volume f4e91c29-493e-416d-a5d0-ccf25a2371f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e91c29-493e-416d-a5d0-ccf25a2371f2', 'volume_size': 1} Dec 11 21:02:37.284404 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] creating volume 'volume-f4e91c29-493e-416d-a5d0-ccf25a2371f2' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:02:37.285861 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:37.390690 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:02:37.392637 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:02:37.395621 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d47d7eb-592e-4084-b74b-9f1d410c7f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e91c29-493e-416d-a5d0-ccf25a2371f2', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:37.399546 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee788214-47c9-414a-a693-ec9b902431b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:37.412273 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Volume volume-f4e91c29-493e-416d-a5d0-ccf25a2371f2 (f4e91c29-493e-416d-a5d0-ccf25a2371f2): created successfully Dec 11 21:02:37.418549 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee788214-47c9-414a-a693-ec9b902431b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:37.422678 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Flow 'volume_create_manager' (35fe8661-944d-42e2-b062-ce557d08210f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:37.443173 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-dfcdbb43-d9d7-4243-985e-6974988f3b22 tempest-VolumesNegativeTest-2043115879 None] Created volume successfully. Dec 11 21:02:37.738088 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-a96efdab-a50c-4e1e-9c0a-f431e818b74f tempest-VolumesActionsTest-1603680914 None] Lock "b'cinder-b476a3b3-71ba-4fb2-becb-5c80cf6feb15-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:02:37.778456 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a96efdab-a50c-4e1e-9c0a-f431e818b74f tempest-VolumesActionsTest-1603680914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:37.857434 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a96efdab-a50c-4e1e-9c0a-f431e818b74f tempest-VolumesActionsTest-1603680914 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:02:37.858534 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a96efdab-a50c-4e1e-9c0a-f431e818b74f tempest-VolumesActionsTest-1603680914 None] Volume volume-b476a3b3-71ba-4fb2-becb-5c80cf6feb15 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:02:37.868781 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a96efdab-a50c-4e1e-9c0a-f431e818b74f tempest-VolumesActionsTest-1603680914 None] deleting rbd volume volume-b476a3b3-71ba-4fb2-becb-5c80cf6feb15 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:02:38.249889 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-a96efdab-a50c-4e1e-9c0a-f431e818b74f tempest-VolumesActionsTest-1603680914 None] Created reservations ['68f04c15-42e1-4705-9438-133831482aa6', 'fc771bd9-455f-40b8-b32e-2bd9538da4a1', '7eb65b3e-292d-4c02-b46f-2646a28344d1', 'ee38ea21-86d2-4ff2-a6d8-3227e542a32b'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:02:38.337853 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a96efdab-a50c-4e1e-9c0a-f431e818b74f tempest-VolumesActionsTest-1603680914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:38.432608 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a96efdab-a50c-4e1e-9c0a-f431e818b74f tempest-VolumesActionsTest-1603680914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:38.493077 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-a96efdab-a50c-4e1e-9c0a-f431e818b74f tempest-VolumesActionsTest-1603680914 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:02:38.513929 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-a96efdab-a50c-4e1e-9c0a-f431e818b74f tempest-VolumesActionsTest-1603680914 None] Deleted volume successfully. Dec 11 21:02:38.533293 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-a96efdab-a50c-4e1e-9c0a-f431e818b74f tempest-VolumesActionsTest-1603680914 None] Lock "b'cinder-b476a3b3-71ba-4fb2-becb-5c80cf6feb15-delete_volume'" released by "delete_volume" :: held 0.795s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:02:39.221986 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:02:39.225602 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:02:39.226141 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:02:39.251088 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Flow 'volume_create_manager' (bf52111a-a611-4fb1-8cbe-6ba2897e8216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:39.254846 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a16ee2-8869-4532-b120-5a00f3af8874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:39.271210 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:02:39.299418 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a16ee2-8869-4532-b120-5a00f3af8874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2140064511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=34dd525a-eacd-4088-a0c3-4100fb3bda3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0391c4e11bf243febd9a93713c1b4ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:02:39Z,use_quota=True,user_id='b91922373b3f47f68bf2bb8a2b8bb333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:39.302788 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39810049-7714-440d-807d-f4f86b0017bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:39.306147 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39810049-7714-440d-807d-f4f86b0017bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:39.310455 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb63d9b-bb24-4ea4-a1d5-0b72528a4784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:39.316185 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb63d9b-bb24-4ea4-a1d5-0b72528a4784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34dd525a-eacd-4088-a0c3-4100fb3bda3f', 'volume_name': 'volume-34dd525a-eacd-4088-a0c3-4100fb3bda3f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:39.318851 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb056cf-7dd9-4cd1-b795-a0c53637b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:39.321980 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb056cf-7dd9-4cd1-b795-a0c53637b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:39.325294 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc402b9-751a-4d58-813c-4db4e4c6c2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:39.326372 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Volume 34dd525a-eacd-4088-a0c3-4100fb3bda3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34dd525a-eacd-4088-a0c3-4100fb3bda3f', 'volume_size': 1} Dec 11 21:02:39.326899 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] creating volume 'volume-34dd525a-eacd-4088-a0c3-4100fb3bda3f' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:02:39.328866 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:39.433124 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:02:39.433792 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:02:39.437333 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc402b9-751a-4d58-813c-4db4e4c6c2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34dd525a-eacd-4088-a0c3-4100fb3bda3f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:39.442453 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fcb152-b96b-4bfc-8516-6d869fa6f825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:39.485998 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Volume volume-34dd525a-eacd-4088-a0c3-4100fb3bda3f (34dd525a-eacd-4088-a0c3-4100fb3bda3f): created successfully Dec 11 21:02:39.488355 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fcb152-b96b-4bfc-8516-6d869fa6f825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:39.492468 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Flow 'volume_create_manager' (bf52111a-a611-4fb1-8cbe-6ba2897e8216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:39.510061 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8270b307-197a-4426-a5a6-51c70b2069e4 tempest-VolumesActionsTest-2028875331 None] Created volume successfully. Dec 11 21:02:40.420717 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-4be440c3-26da-43f2-ac0e-860496819d07 tempest-VolumesActionsTest-1603680914 None] Lock "b'cinder-34dd525a-eacd-4088-a0c3-4100fb3bda3f-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:02:40.448401 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4be440c3-26da-43f2-ac0e-860496819d07 tempest-VolumesActionsTest-1603680914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:40.530909 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4be440c3-26da-43f2-ac0e-860496819d07 tempest-VolumesActionsTest-1603680914 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:02:40.531713 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4be440c3-26da-43f2-ac0e-860496819d07 tempest-VolumesActionsTest-1603680914 None] Volume volume-34dd525a-eacd-4088-a0c3-4100fb3bda3f is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:02:40.538660 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4be440c3-26da-43f2-ac0e-860496819d07 tempest-VolumesActionsTest-1603680914 None] deleting rbd volume volume-34dd525a-eacd-4088-a0c3-4100fb3bda3f {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:02:40.903405 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-4be440c3-26da-43f2-ac0e-860496819d07 tempest-VolumesActionsTest-1603680914 None] Created reservations ['5421f403-3367-4a03-9b91-4a7c2c15ea7d', '4ff454b5-41e5-4b9e-a638-198e7c869642', '50464864-ddd9-4817-93bd-94dfcc5d4897', 'b9615f37-df58-4349-8d71-265c503ccfe1'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:02:40.962281 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4be440c3-26da-43f2-ac0e-860496819d07 tempest-VolumesActionsTest-1603680914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:41.039647 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4be440c3-26da-43f2-ac0e-860496819d07 tempest-VolumesActionsTest-1603680914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:41.112643 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-4be440c3-26da-43f2-ac0e-860496819d07 tempest-VolumesActionsTest-1603680914 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:02:41.122021 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4be440c3-26da-43f2-ac0e-860496819d07 tempest-VolumesActionsTest-1603680914 None] Deleted volume successfully. Dec 11 21:02:41.142282 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-4be440c3-26da-43f2-ac0e-860496819d07 tempest-VolumesActionsTest-1603680914 None] Lock "b'cinder-34dd525a-eacd-4088-a0c3-4100fb3bda3f-delete_volume'" released by "delete_volume" :: held 0.721s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:02:41.895230 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:02:41.898576 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:02:41.899277 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:02:41.914390 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Flow 'volume_create_manager' (07e9fea2-4268-4a3b-8be0-7105e4dfb6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:41.918192 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472741a2-3443-4b9b-bc1a-e4e7e5aa58c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:41.926915 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:02:41.940540 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472741a2-3443-4b9b-bc1a-e4e7e5aa58c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-736748256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a22a136e-40e4-48dc-8fc1-c5bb0da00d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0391c4e11bf243febd9a93713c1b4ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:02:42Z,use_quota=True,user_id='b91922373b3f47f68bf2bb8a2b8bb333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:41.943538 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f198e167-3175-4567-8ca7-26a5b022d73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:41.945872 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f198e167-3175-4567-8ca7-26a5b022d73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:41.948661 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b96cba-c14c-4eba-9731-5174ee5980e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:41.951210 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b96cba-c14c-4eba-9731-5174ee5980e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a22a136e-40e4-48dc-8fc1-c5bb0da00d08', 'volume_name': 'volume-a22a136e-40e4-48dc-8fc1-c5bb0da00d08', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:41.954758 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cdbf08-6b67-43c3-8573-f069274b5a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:41.958007 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cdbf08-6b67-43c3-8573-f069274b5a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:41.961657 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7938962c-ad10-46db-9f3b-fb96eddd4fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:41.963606 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Volume a22a136e-40e4-48dc-8fc1-c5bb0da00d08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a22a136e-40e4-48dc-8fc1-c5bb0da00d08', 'volume_size': 1} Dec 11 21:02:41.964373 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] creating volume 'volume-a22a136e-40e4-48dc-8fc1-c5bb0da00d08' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:02:41.965747 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:42.095877 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:02:42.096326 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:02:42.099506 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7938962c-ad10-46db-9f3b-fb96eddd4fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22a136e-40e4-48dc-8fc1-c5bb0da00d08', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:42.104085 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa78cc54-b4ae-4cbe-869f-efbb3a5e51c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:42.121649 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Volume volume-a22a136e-40e4-48dc-8fc1-c5bb0da00d08 (a22a136e-40e4-48dc-8fc1-c5bb0da00d08): created successfully Dec 11 21:02:42.124821 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa78cc54-b4ae-4cbe-869f-efbb3a5e51c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:42.128759 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Flow 'volume_create_manager' (07e9fea2-4268-4a3b-8be0-7105e4dfb6c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:42.141936 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-31f1ece1-cb3a-422e-ae98-7a4d2de8f095 tempest-VolumesActionsTest-2028875331 None] Created volume successfully. Dec 11 21:02:43.249566 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-fbdfaef2-c1b2-4b31-9e16-335cd11ec409 tempest-VolumesActionsTest-1603680914 None] Lock "b'cinder-a22a136e-40e4-48dc-8fc1-c5bb0da00d08-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:02:43.315815 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fbdfaef2-c1b2-4b31-9e16-335cd11ec409 tempest-VolumesActionsTest-1603680914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:43.412641 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fbdfaef2-c1b2-4b31-9e16-335cd11ec409 tempest-VolumesActionsTest-1603680914 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:02:43.413460 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fbdfaef2-c1b2-4b31-9e16-335cd11ec409 tempest-VolumesActionsTest-1603680914 None] Volume volume-a22a136e-40e4-48dc-8fc1-c5bb0da00d08 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:02:43.424874 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fbdfaef2-c1b2-4b31-9e16-335cd11ec409 tempest-VolumesActionsTest-1603680914 None] deleting rbd volume volume-a22a136e-40e4-48dc-8fc1-c5bb0da00d08 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:02:43.860476 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-fbdfaef2-c1b2-4b31-9e16-335cd11ec409 tempest-VolumesActionsTest-1603680914 None] Created reservations ['da277c2c-c8a0-4757-b1a8-ade4338b30a9', '0e2db81f-5a89-4151-b32a-53a95bba5bff', '0609d258-cb1e-4fee-b4ee-94d16e0d74b2', '4b2085c6-4a3b-480f-96ca-1aa12930db8c'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:02:43.968234 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fbdfaef2-c1b2-4b31-9e16-335cd11ec409 tempest-VolumesActionsTest-1603680914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:44.045215 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fbdfaef2-c1b2-4b31-9e16-335cd11ec409 tempest-VolumesActionsTest-1603680914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:44.115724 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-fbdfaef2-c1b2-4b31-9e16-335cd11ec409 tempest-VolumesActionsTest-1603680914 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:02:44.119891 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-fbdfaef2-c1b2-4b31-9e16-335cd11ec409 tempest-VolumesActionsTest-1603680914 None] Deleted volume successfully. Dec 11 21:02:44.142601 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-fbdfaef2-c1b2-4b31-9e16-335cd11ec409 tempest-VolumesActionsTest-1603680914 None] Lock "b'cinder-a22a136e-40e4-48dc-8fc1-c5bb0da00d08-delete_volume'" released by "delete_volume" :: held 0.894s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:02:45.149025 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:02:45.154133 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:02:45.154704 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:02:45.171379 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Flow 'volume_create_manager' (b3ceb8c1-39cf-45cd-8f6a-ec7899a2f365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:45.175622 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff88272-0650-43f2-9d2d-6d1acdbe4631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:45.182188 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:02:45.196793 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff88272-0650-43f2-9d2d-6d1acdbe4631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2004959486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0a30dd92-59b2-4c48-9bd6-e21b0e3f310e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0391c4e11bf243febd9a93713c1b4ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:02:45Z,use_quota=True,user_id='b91922373b3f47f68bf2bb8a2b8bb333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:45.200413 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082ed89a-f3a7-4822-8441-741f6379658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:45.204990 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082ed89a-f3a7-4822-8441-741f6379658b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:45.210494 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090ee143-44ef-42e1-871a-09f902e89015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:45.223237 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090ee143-44ef-42e1-871a-09f902e89015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a30dd92-59b2-4c48-9bd6-e21b0e3f310e', 'volume_name': 'volume-0a30dd92-59b2-4c48-9bd6-e21b0e3f310e', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:45.225984 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c574523-5f5e-46d8-8cde-18157b1d61b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:45.230218 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c574523-5f5e-46d8-8cde-18157b1d61b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:45.233298 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11eb87a-3b16-45e3-bb86-ae8d7231b5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:45.234303 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Volume 0a30dd92-59b2-4c48-9bd6-e21b0e3f310e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a30dd92-59b2-4c48-9bd6-e21b0e3f310e', 'volume_size': 1} Dec 11 21:02:45.235244 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] creating volume 'volume-0a30dd92-59b2-4c48-9bd6-e21b0e3f310e' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:02:45.236858 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:45.364929 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:02:45.365397 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:02:45.368377 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11eb87a-3b16-45e3-bb86-ae8d7231b5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a30dd92-59b2-4c48-9bd6-e21b0e3f310e', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:45.371467 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c4c282-e617-4301-9907-13a3f0a9f340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:45.384386 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Volume volume-0a30dd92-59b2-4c48-9bd6-e21b0e3f310e (0a30dd92-59b2-4c48-9bd6-e21b0e3f310e): created successfully Dec 11 21:02:45.386681 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c4c282-e617-4301-9907-13a3f0a9f340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:45.396018 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Flow 'volume_create_manager' (b3ceb8c1-39cf-45cd-8f6a-ec7899a2f365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:45.414103 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c2cf0f96-c17b-4b7c-9d06-a4cb874266a7 tempest-VolumesActionsTest-2028875331 None] Created volume successfully. Dec 11 21:02:46.376378 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-60d80e88-b9d0-40b0-a285-b6d32dde1e4d tempest-VolumesActionsTest-1603680914 None] Lock "b'cinder-0a30dd92-59b2-4c48-9bd6-e21b0e3f310e-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:02:46.435127 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-60d80e88-b9d0-40b0-a285-b6d32dde1e4d tempest-VolumesActionsTest-1603680914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:46.566764 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-60d80e88-b9d0-40b0-a285-b6d32dde1e4d tempest-VolumesActionsTest-1603680914 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:02:46.567192 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-60d80e88-b9d0-40b0-a285-b6d32dde1e4d tempest-VolumesActionsTest-1603680914 None] Volume volume-0a30dd92-59b2-4c48-9bd6-e21b0e3f310e is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:02:46.584102 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-60d80e88-b9d0-40b0-a285-b6d32dde1e4d tempest-VolumesActionsTest-1603680914 None] deleting rbd volume volume-0a30dd92-59b2-4c48-9bd6-e21b0e3f310e {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:02:47.120003 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-60d80e88-b9d0-40b0-a285-b6d32dde1e4d tempest-VolumesActionsTest-1603680914 None] Created reservations ['62390928-2350-423c-a8d9-3c757f11a91e', '34774be9-5b72-4e13-8c4c-2d25afe40d49', '7563e1f9-39ed-4113-b9fc-a8eb2efd4407', '1ab073e4-4916-4965-afea-c102f25ba293'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:02:47.217196 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-60d80e88-b9d0-40b0-a285-b6d32dde1e4d tempest-VolumesActionsTest-1603680914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:47.279869 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-60d80e88-b9d0-40b0-a285-b6d32dde1e4d tempest-VolumesActionsTest-1603680914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:47.343262 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-60d80e88-b9d0-40b0-a285-b6d32dde1e4d tempest-VolumesActionsTest-1603680914 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:02:47.347937 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-60d80e88-b9d0-40b0-a285-b6d32dde1e4d tempest-VolumesActionsTest-1603680914 None] Deleted volume successfully. Dec 11 21:02:47.369522 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-60d80e88-b9d0-40b0-a285-b6d32dde1e4d tempest-VolumesActionsTest-1603680914 None] Lock "b'cinder-0a30dd92-59b2-4c48-9bd6-e21b0e3f310e-delete_volume'" released by "delete_volume" :: held 0.993s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:02:47.964626 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:02:47.970201 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:02:47.971134 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:02:47.996151 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Flow 'volume_create_manager' (c1e803b4-b3e0-4089-96cd-879396d28fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:48.003520 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa09008c-4cdb-4d04-921f-a2e98ec6beb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:48.011225 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:02:48.028200 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa09008c-4cdb-4d04-921f-a2e98ec6beb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2050044211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=759a144e-87c7-482b-9437-c4ecac055f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0391c4e11bf243febd9a93713c1b4ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:02:48Z,use_quota=True,user_id='b91922373b3f47f68bf2bb8a2b8bb333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:48.031012 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992c9b10-e497-45fb-aa25-d87a8d1160ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:48.033289 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992c9b10-e497-45fb-aa25-d87a8d1160ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:48.035878 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7255609a-43b6-437e-b2ce-2c48862311a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:48.038165 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7255609a-43b6-437e-b2ce-2c48862311a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759a144e-87c7-482b-9437-c4ecac055f9b', 'volume_name': 'volume-759a144e-87c7-482b-9437-c4ecac055f9b', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:48.040559 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736a1161-330d-44f0-9037-0eed1e2c185b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:48.042990 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736a1161-330d-44f0-9037-0eed1e2c185b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:48.045837 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cae17a-4788-4880-9468-2693aac27cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:48.046840 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Volume 759a144e-87c7-482b-9437-c4ecac055f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759a144e-87c7-482b-9437-c4ecac055f9b', 'volume_size': 1} Dec 11 21:02:48.047235 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] creating volume 'volume-759a144e-87c7-482b-9437-c4ecac055f9b' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:02:48.048228 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:48.149703 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:02:48.150233 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:02:48.152714 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cae17a-4788-4880-9468-2693aac27cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759a144e-87c7-482b-9437-c4ecac055f9b', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:48.156795 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0814d850-41f1-49ce-ae42-29ab3837d0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:48.167761 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Volume volume-759a144e-87c7-482b-9437-c4ecac055f9b (759a144e-87c7-482b-9437-c4ecac055f9b): created successfully Dec 11 21:02:48.171373 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0814d850-41f1-49ce-ae42-29ab3837d0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:48.174864 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Flow 'volume_create_manager' (c1e803b4-b3e0-4089-96cd-879396d28fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:48.185604 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7ddcc2b2-cbfe-4e37-9ea2-639874ef6ae8 tempest-VolumesActionsTest-2028875331 None] Created volume successfully. Dec 11 21:02:49.635286 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-a0ff629e-50e1-4763-8010-70a01dd7b6c8 tempest-VolumesActionsTest-2028875331 None] Lock "b'cinder-759a144e-87c7-482b-9437-c4ecac055f9b-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:02:49.679966 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a0ff629e-50e1-4763-8010-70a01dd7b6c8 tempest-VolumesActionsTest-2028875331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:49.733091 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a0ff629e-50e1-4763-8010-70a01dd7b6c8 tempest-VolumesActionsTest-2028875331 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:02:49.733517 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a0ff629e-50e1-4763-8010-70a01dd7b6c8 tempest-VolumesActionsTest-2028875331 None] Volume volume-759a144e-87c7-482b-9437-c4ecac055f9b is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:02:49.739359 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a0ff629e-50e1-4763-8010-70a01dd7b6c8 tempest-VolumesActionsTest-2028875331 None] deleting rbd volume volume-759a144e-87c7-482b-9437-c4ecac055f9b {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:02:50.036487 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-a0ff629e-50e1-4763-8010-70a01dd7b6c8 tempest-VolumesActionsTest-2028875331 None] Created reservations ['f96a9490-9ec0-4193-8a20-3103041f5189', '9d3ac52d-1473-46c7-b218-21dc9bd3d330', 'e801d2c6-75ad-476c-961f-68952d3bc4d0', '2864205b-b6a7-456b-ba67-5cefbeafb4cb'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:02:50.107154 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a0ff629e-50e1-4763-8010-70a01dd7b6c8 tempest-VolumesActionsTest-2028875331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:50.168591 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a0ff629e-50e1-4763-8010-70a01dd7b6c8 tempest-VolumesActionsTest-2028875331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:50.234175 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-a0ff629e-50e1-4763-8010-70a01dd7b6c8 tempest-VolumesActionsTest-2028875331 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:02:50.239903 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-a0ff629e-50e1-4763-8010-70a01dd7b6c8 tempest-VolumesActionsTest-2028875331 None] Deleted volume successfully. Dec 11 21:02:50.266067 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-a0ff629e-50e1-4763-8010-70a01dd7b6c8 tempest-VolumesActionsTest-2028875331 None] Lock "b'cinder-759a144e-87c7-482b-9437-c4ecac055f9b-delete_volume'" released by "delete_volume" :: held 0.631s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:02:50.935299 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-1b6ef20a-1b44-49fa-9f35-458022993ef8 tempest-VolumesActionsTest-2028875331 None] Lock "b'cinder-c22fef7f-8239-477a-b82d-59ecc34c91bf-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:02:50.997548 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1b6ef20a-1b44-49fa-9f35-458022993ef8 tempest-VolumesActionsTest-2028875331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:51.090925 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1b6ef20a-1b44-49fa-9f35-458022993ef8 tempest-VolumesActionsTest-2028875331 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:02:51.091746 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1b6ef20a-1b44-49fa-9f35-458022993ef8 tempest-VolumesActionsTest-2028875331 None] Volume volume-c22fef7f-8239-477a-b82d-59ecc34c91bf is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:02:51.101451 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1b6ef20a-1b44-49fa-9f35-458022993ef8 tempest-VolumesActionsTest-2028875331 None] deleting rbd volume volume-c22fef7f-8239-477a-b82d-59ecc34c91bf {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:02:51.504091 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-1b6ef20a-1b44-49fa-9f35-458022993ef8 tempest-VolumesActionsTest-2028875331 None] Created reservations ['49f00005-551f-4267-a478-68bafd259e4f', '7ef352e4-9bc8-4260-aa76-66c7e5e9f4ac', '2b6fecf2-67b8-40b8-b949-7015115c814c', 'e1128163-27ba-4529-ba5b-1d31e07ed75c'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:02:51.580550 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1b6ef20a-1b44-49fa-9f35-458022993ef8 tempest-VolumesActionsTest-2028875331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:51.654103 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1b6ef20a-1b44-49fa-9f35-458022993ef8 tempest-VolumesActionsTest-2028875331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:51.714038 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-1b6ef20a-1b44-49fa-9f35-458022993ef8 tempest-VolumesActionsTest-2028875331 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:02:51.718629 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1b6ef20a-1b44-49fa-9f35-458022993ef8 tempest-VolumesActionsTest-2028875331 None] Deleted volume successfully. Dec 11 21:02:51.740568 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-1b6ef20a-1b44-49fa-9f35-458022993ef8 tempest-VolumesActionsTest-2028875331 None] Lock "b'cinder-c22fef7f-8239-477a-b82d-59ecc34c91bf-delete_volume'" released by "delete_volume" :: held 0.805s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:02:55.060573 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:02:55.063539 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:55.134055 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:55.204084 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:02:59.784441 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:02:59.789847 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:02:59.790344 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:02:59.808455 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Flow 'volume_create_manager' (4f91c077-1269-4022-b833-c670243425ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:59.812273 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d41abd3-8865-4df0-af82-5264d8ffc3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:59.820048 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:02:59.835514 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d41abd3-8865-4df0-af82-5264d8ffc3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1359015679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1fb6e0c-6beb-4960-ae37-f401a74076fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d714ef66e04343fe84c358c2b415af97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:03:00Z,use_quota=True,user_id='d74099c354454e839cfb0730f0671b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:59.837564 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbbb2c8-0633-46be-a181-faa7f2a34ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:59.839736 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbbb2c8-0633-46be-a181-faa7f2a34ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:59.842703 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936f2e68-9a4c-4934-98b6-80186291663f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:59.844959 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936f2e68-9a4c-4934-98b6-80186291663f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1fb6e0c-6beb-4960-ae37-f401a74076fb', 'volume_name': 'volume-c1fb6e0c-6beb-4960-ae37-f401a74076fb', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:59.848291 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f47138a-a101-4ad2-b04b-f0758470931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:59.850896 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f47138a-a101-4ad2-b04b-f0758470931b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:59.853091 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e195794-c566-410c-9dbc-cfce4f30b1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:59.854021 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Volume c1fb6e0c-6beb-4960-ae37-f401a74076fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1fb6e0c-6beb-4960-ae37-f401a74076fb', 'volume_size': 1} Dec 11 21:02:59.854693 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] creating volume 'volume-c1fb6e0c-6beb-4960-ae37-f401a74076fb' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:02:59.855856 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:02:59.951993 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:02:59.952898 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:02:59.955535 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e195794-c566-410c-9dbc-cfce4f30b1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fb6e0c-6beb-4960-ae37-f401a74076fb', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:59.958923 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc4e6d2-404b-45e7-809e-b7961266a542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:02:59.971881 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Volume volume-c1fb6e0c-6beb-4960-ae37-f401a74076fb (c1fb6e0c-6beb-4960-ae37-f401a74076fb): created successfully Dec 11 21:02:59.974356 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc4e6d2-404b-45e7-809e-b7961266a542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:02:59.977920 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Flow 'volume_create_manager' (4f91c077-1269-4022-b833-c670243425ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:02:59.990265 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-2108ee07-a661-4f9d-87f1-9dbee199f748 tempest-SnapshotMetadataTestJSON-1506160061 None] Created volume successfully. Dec 11 21:03:01.175761 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bc1c0bc8-54ae-4dbb-9c6a-93c43f86fc9a tempest-SnapshotMetadataTestJSON-1506160061 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:01.697853 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-bc1c0bc8-54ae-4dbb-9c6a-93c43f86fc9a tempest-SnapshotMetadataTestJSON-1506160061 None] Create snapshot completed successfully Dec 11 21:03:03.401825 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d6e9455b-4bd4-49f2-8146-81ec77e05b3a tempest-SnapshotMetadataTestJSON-1506160061 None] Lock "b'cinder-ce26569a-42f5-47fc-9c07-ccf5552301ae-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:03:03.407800 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d6e9455b-4bd4-49f2-8146-81ec77e05b3a tempest-SnapshotMetadataTestJSON-1506160061 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:04.267868 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-59cb65a7-4cbd-422f-bf14-ca4292c17683 tempest-VolumesNegativeTest-2043115879 None] Lock "b'cinder-f4e91c29-493e-416d-a5d0-ccf25a2371f2-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:03:04.342082 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-59cb65a7-4cbd-422f-bf14-ca4292c17683 tempest-VolumesNegativeTest-2043115879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:04.447782 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-59cb65a7-4cbd-422f-bf14-ca4292c17683 tempest-VolumesNegativeTest-2043115879 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:03:04.448385 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-59cb65a7-4cbd-422f-bf14-ca4292c17683 tempest-VolumesNegativeTest-2043115879 None] Volume volume-f4e91c29-493e-416d-a5d0-ccf25a2371f2 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:03:04.459882 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-59cb65a7-4cbd-422f-bf14-ca4292c17683 tempest-VolumesNegativeTest-2043115879 None] deleting rbd volume volume-f4e91c29-493e-416d-a5d0-ccf25a2371f2 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:03:04.873901 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-d6e9455b-4bd4-49f2-8146-81ec77e05b3a tempest-SnapshotMetadataTestJSON-1506160061 None] Created reservations ['c39dd7dc-925a-4255-b2e5-6ed873a407c6', '02ff1d69-7c14-4d86-91af-1277e9225519', 'afb66a33-6e54-47e5-954c-118f8a2ecceb', 'a9ab91dc-f44d-45c0-a133-94183760789e'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:03:04.928027 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d6e9455b-4bd4-49f2-8146-81ec77e05b3a tempest-SnapshotMetadataTestJSON-1506160061 None] Delete snapshot completed successfully. Dec 11 21:03:04.970996 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d6e9455b-4bd4-49f2-8146-81ec77e05b3a tempest-SnapshotMetadataTestJSON-1506160061 None] Lock "b'cinder-ce26569a-42f5-47fc-9c07-ccf5552301ae-delete_snapshot'" released by "delete_snapshot" :: held 1.570s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:03:05.008164 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-59cb65a7-4cbd-422f-bf14-ca4292c17683 tempest-VolumesNegativeTest-2043115879 None] Created reservations ['23b7e53e-fa8d-4c21-826f-ebdbdadf4b09', 'e5b958e6-3beb-4c60-99fd-91c6c2494955', '4481278c-8e0d-4813-bd1d-88f966c29a60', '18892044-e755-4d12-a379-d232db6dff22'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:03:05.084731 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-59cb65a7-4cbd-422f-bf14-ca4292c17683 tempest-VolumesNegativeTest-2043115879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:05.181207 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-59cb65a7-4cbd-422f-bf14-ca4292c17683 tempest-VolumesNegativeTest-2043115879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:05.252647 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-59cb65a7-4cbd-422f-bf14-ca4292c17683 tempest-VolumesNegativeTest-2043115879 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:03:05.265410 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-59cb65a7-4cbd-422f-bf14-ca4292c17683 tempest-VolumesNegativeTest-2043115879 None] Deleted volume successfully. Dec 11 21:03:05.285517 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-59cb65a7-4cbd-422f-bf14-ca4292c17683 tempest-VolumesNegativeTest-2043115879 None] Lock "b'cinder-f4e91c29-493e-416d-a5d0-ccf25a2371f2-delete_volume'" released by "delete_volume" :: held 1.018s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:03:05.576055 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:03:05.580373 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:03:05.580831 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:03:05.604963 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Flow 'volume_create_manager' (551c788d-b983-45e8-b3cf-a357e640058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:03:05.609184 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d1d151-35a7-44e2-8db9-7285714fdb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:05.627578 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:03:05.648431 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d1d151-35a7-44e2-8db9-7285714fdb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1461346875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c7910b47-de22-4de6-898a-baf89e2af426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f23e4b64db4ca49448b3d9290e997f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:03:06Z,use_quota=True,user_id='a5668c1b876c47ce8e9282aaa89c8ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:05.658662 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b6776e-fe1d-442c-8dc3-6c5237cda275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:05.662714 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b6776e-fe1d-442c-8dc3-6c5237cda275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:05.665796 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827f6426-20a8-4f7c-a1dd-0b44c4bf778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:05.668577 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827f6426-20a8-4f7c-a1dd-0b44c4bf778a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7910b47-de22-4de6-898a-baf89e2af426', 'volume_name': 'volume-c7910b47-de22-4de6-898a-baf89e2af426', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:05.671840 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d045679-7aa3-4567-b9d1-20d0329f7672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:05.675845 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d045679-7aa3-4567-b9d1-20d0329f7672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:05.681101 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe37d6d-9421-45ef-b965-4e31bb057b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:05.683037 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Volume c7910b47-de22-4de6-898a-baf89e2af426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7910b47-de22-4de6-898a-baf89e2af426', 'volume_size': 1} Dec 11 21:03:05.683632 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] creating volume 'volume-c7910b47-de22-4de6-898a-baf89e2af426' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:03:05.684840 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:05.783579 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-457985ff-b2fc-4f1e-bca6-7361d18e01a5 tempest-SnapshotMetadataTestJSON-1506160061 None] Lock "b'cinder-c1fb6e0c-6beb-4960-ae37-f401a74076fb-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:03:05.822378 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-457985ff-b2fc-4f1e-bca6-7361d18e01a5 tempest-SnapshotMetadataTestJSON-1506160061 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:05.901256 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-457985ff-b2fc-4f1e-bca6-7361d18e01a5 tempest-SnapshotMetadataTestJSON-1506160061 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:03:05.901936 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-457985ff-b2fc-4f1e-bca6-7361d18e01a5 tempest-SnapshotMetadataTestJSON-1506160061 None] Volume volume-c1fb6e0c-6beb-4960-ae37-f401a74076fb is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:03:05.922995 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-457985ff-b2fc-4f1e-bca6-7361d18e01a5 tempest-SnapshotMetadataTestJSON-1506160061 None] deleting rbd volume volume-c1fb6e0c-6beb-4960-ae37-f401a74076fb {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:03:05.933683 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:03:05.934060 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:03:05.937771 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe37d6d-9421-45ef-b965-4e31bb057b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7910b47-de22-4de6-898a-baf89e2af426', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:05.940044 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2092cfc0-4e2f-4269-827d-dbed0a4c23c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:05.958531 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Volume volume-c7910b47-de22-4de6-898a-baf89e2af426 (c7910b47-de22-4de6-898a-baf89e2af426): created successfully Dec 11 21:03:05.960570 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2092cfc0-4e2f-4269-827d-dbed0a4c23c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:05.963903 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Flow 'volume_create_manager' (551c788d-b983-45e8-b3cf-a357e640058f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:03:05.985068 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-37b8356c-e7a6-447b-abb0-d24f2fa41d35 tempest-DeleteServersTestJSON-1962391540 None] Created volume successfully. Dec 11 21:03:06.368106 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-457985ff-b2fc-4f1e-bca6-7361d18e01a5 tempest-SnapshotMetadataTestJSON-1506160061 None] Created reservations ['92db4aa4-0bea-458d-a28b-3c3f7c1228a6', 'cb69ac89-ef27-4f24-a8c6-fb879a36c730', '2c606531-7aa1-467b-827e-e6dcac8c3750', '618021db-1acd-4c8b-b257-562c394c270f'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:03:06.427286 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-457985ff-b2fc-4f1e-bca6-7361d18e01a5 tempest-SnapshotMetadataTestJSON-1506160061 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:06.483320 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-457985ff-b2fc-4f1e-bca6-7361d18e01a5 tempest-SnapshotMetadataTestJSON-1506160061 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:06.559108 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-457985ff-b2fc-4f1e-bca6-7361d18e01a5 tempest-SnapshotMetadataTestJSON-1506160061 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:03:06.567187 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-457985ff-b2fc-4f1e-bca6-7361d18e01a5 tempest-SnapshotMetadataTestJSON-1506160061 None] Deleted volume successfully. Dec 11 21:03:06.595579 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-457985ff-b2fc-4f1e-bca6-7361d18e01a5 tempest-SnapshotMetadataTestJSON-1506160061 None] Lock "b'cinder-c1fb6e0c-6beb-4960-ae37-f401a74076fb-delete_volume'" released by "delete_volume" :: held 0.812s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:03:07.107878 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-fd9cbd79-89de-42c2-aab3-8ea5ac5e408b req-d0b8cb36-7aae-464b-a1e2-ffe0e3433e4d tempest-DeleteServersTestJSON-1962391540 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:03:08.026359 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-fd9cbd79-89de-42c2-aab3-8ea5ac5e408b req-d0b8cb36-7aae-464b-a1e2-ffe0e3433e4d tempest-DeleteServersTestJSON-1962391540 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.930s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:03:08.027140 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-fd9cbd79-89de-42c2-aab3-8ea5ac5e408b req-d0b8cb36-7aae-464b-a1e2-ffe0e3433e4d tempest-DeleteServersTestJSON-1962391540 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c7910b47-de22-4de6-898a-baf89e2af426', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'c7910b47-de22-4de6-898a-baf89e2af426', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:03:08.058265 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-fd9cbd79-89de-42c2-aab3-8ea5ac5e408b req-d0b8cb36-7aae-464b-a1e2-ffe0e3433e4d tempest-DeleteServersTestJSON-1962391540 None] Connection info returned from driver {'name': 'volumes/volume-c7910b47-de22-4de6-898a-baf89e2af426', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c7910b47-de22-4de6-898a-baf89e2af426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '934e0bcb-dc56-4e80-83d7-b43ecbda820e'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:03:08.118527 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-fd9cbd79-89de-42c2-aab3-8ea5ac5e408b req-d0b8cb36-7aae-464b-a1e2-ffe0e3433e4d tempest-DeleteServersTestJSON-1962391540 None] attachment_update completed successfully. Dec 11 21:03:13.974640 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:03:13.979269 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:03:13.979857 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:03:13.998624 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Flow 'volume_create_manager' (39581526-0ba3-4dc1-b689-885cd1fedf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:03:14.004132 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2290baf6-1045-4897-8025-757042101b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:14.024839 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:03:14.051847 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2290baf6-1045-4897-8025-757042101b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1658324411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d7c48b2a-ad5c-4686-966c-146b3eefe548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8ecda4828f416895c78e6c94177832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:03:14Z,use_quota=True,user_id='7814d163442c4f9a919e4abb417b1bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:14.055968 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2107d06-be73-4740-b646-aa824883a2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:14.059471 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2107d06-be73-4740-b646-aa824883a2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:14.063123 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a9e76c-7cfb-4c14-9c93-4c6345a6b36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:14.066979 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a9e76c-7cfb-4c14-9c93-4c6345a6b36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7c48b2a-ad5c-4686-966c-146b3eefe548', 'volume_name': 'volume-d7c48b2a-ad5c-4686-966c-146b3eefe548', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:14.070370 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ba49f7-ffbc-4524-b4b5-d38f58d2530e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:14.073117 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ba49f7-ffbc-4524-b4b5-d38f58d2530e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:14.077281 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8342f138-9bae-4b59-99f6-9b17f823f615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:14.078450 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Volume d7c48b2a-ad5c-4686-966c-146b3eefe548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7c48b2a-ad5c-4686-966c-146b3eefe548', 'volume_size': 1} Dec 11 21:03:14.079064 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] creating volume 'volume-d7c48b2a-ad5c-4686-966c-146b3eefe548' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:03:14.080631 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:14.148315 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-0696d8d0-b78f-40ea-863e-bdd2721a791f req-bc93e33d-0bd5-48e6-a95e-92b8070012ed tempest-DeleteServersTestJSON-1962391540 None] Terminate volume connection completed successfully. Dec 11 21:03:14.148793 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-0696d8d0-b78f-40ea-863e-bdd2721a791f req-bc93e33d-0bd5-48e6-a95e-92b8070012ed tempest-DeleteServersTestJSON-1962391540 None] Deleting attachment 934e0bcb-dc56-4e80-83d7-b43ecbda820e. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:03:14.240052 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:03:14.240730 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:03:14.242979 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8342f138-9bae-4b59-99f6-9b17f823f615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7c48b2a-ad5c-4686-966c-146b3eefe548', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:14.245434 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268a7400-2370-4bee-a5e0-2625a27432ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:14.271103 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Volume volume-d7c48b2a-ad5c-4686-966c-146b3eefe548 (d7c48b2a-ad5c-4686-966c-146b3eefe548): created successfully Dec 11 21:03:14.273632 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268a7400-2370-4bee-a5e0-2625a27432ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:14.277167 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Flow 'volume_create_manager' (39581526-0ba3-4dc1-b689-885cd1fedf5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:03:14.313111 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-49f635fb-6599-407f-a674-c10dff10efc1 tempest-AbsoluteLimitsTests-1203552874 None] Created volume successfully. Dec 11 21:03:15.154341 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-172e1f29-8e3a-45ca-bb4b-b1399fdc8cac tempest-AbsoluteLimitsTests-1203552874 None] Lock "b'cinder-d7c48b2a-ad5c-4686-966c-146b3eefe548-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:03:15.217506 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-172e1f29-8e3a-45ca-bb4b-b1399fdc8cac tempest-AbsoluteLimitsTests-1203552874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:15.348197 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-172e1f29-8e3a-45ca-bb4b-b1399fdc8cac tempest-AbsoluteLimitsTests-1203552874 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:03:15.348646 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-172e1f29-8e3a-45ca-bb4b-b1399fdc8cac tempest-AbsoluteLimitsTests-1203552874 None] Volume volume-d7c48b2a-ad5c-4686-966c-146b3eefe548 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:03:15.361681 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-172e1f29-8e3a-45ca-bb4b-b1399fdc8cac tempest-AbsoluteLimitsTests-1203552874 None] deleting rbd volume volume-d7c48b2a-ad5c-4686-966c-146b3eefe548 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:03:15.909102 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-172e1f29-8e3a-45ca-bb4b-b1399fdc8cac tempest-AbsoluteLimitsTests-1203552874 None] Created reservations ['ac185722-93d9-4900-9a59-ff0f2904544d', 'bdb92540-806a-44fd-a0ef-2257ea8eabb6', 'ddd348b4-d4bc-4c3c-9a60-e333e0c00c6d', '54b4d8a2-62f3-4404-9c0d-5b8fde368ea7'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:03:16.001157 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-172e1f29-8e3a-45ca-bb4b-b1399fdc8cac tempest-AbsoluteLimitsTests-1203552874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:16.091645 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-172e1f29-8e3a-45ca-bb4b-b1399fdc8cac tempest-AbsoluteLimitsTests-1203552874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:16.182725 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-172e1f29-8e3a-45ca-bb4b-b1399fdc8cac tempest-AbsoluteLimitsTests-1203552874 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:03:16.193954 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-172e1f29-8e3a-45ca-bb4b-b1399fdc8cac tempest-AbsoluteLimitsTests-1203552874 None] Deleted volume successfully. Dec 11 21:03:16.214677 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-172e1f29-8e3a-45ca-bb4b-b1399fdc8cac tempest-AbsoluteLimitsTests-1203552874 None] Lock "b'cinder-d7c48b2a-ad5c-4686-966c-146b3eefe548-delete_volume'" released by "delete_volume" :: held 1.064s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:03:54.592576 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:03:54.601599 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:03:54.602752 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:03:54.621844 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Flow 'volume_create_manager' (ae339618-cbc8-40d2-a08a-3c23e1483783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:03:54.627216 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52052655-a8fe-482c-b409-45335e0404a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:54.635350 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:03:54.653160 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52052655-a8fe-482c-b409-45335e0404a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1869776714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e91091650141658a6c126a3884f5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:03:54Z,use_quota=True,user_id='7af4a401395b425fb07a24a603bb617f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:54.657516 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d865324-3c3b-45a3-a112-8de4a0952ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:54.660917 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d865324-3c3b-45a3-a112-8de4a0952ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:54.664910 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd471174-d410-40a5-8ce1-02d1b59f00b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:54.790856 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd471174-d410-40a5-8ce1-02d1b59f00b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d', 'volume_name': 'volume-7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:54.798624 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdde9a5-baf6-4d56-99cd-9f3d7c08b9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:54.801443 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdde9a5-baf6-4d56-99cd-9f3d7c08b9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:54.811542 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36a369d-3efb-461c-a238-8ba79c266644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:54.815077 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Volume 7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 21:03:54.815694 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Cloning 7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 21:03:54.836323 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.020s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:03:54.866263 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 3, 54, 849216)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:03:54.867030 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:03:54.867590 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 21:03:54.874218 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.037s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:03:54.875490 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 21:03:54.882019 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 3, 54, 879129)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:03:54.882808 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:03:54.883394 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 21:03:54.898101 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:54.991237 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] creating snapshot='volume-7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:03:55.832877 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d.clone_snap' to 'volume-7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:03:55.835980 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:03:55.839280 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:55.944313 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:03:56.047145 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:03:56.111961 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:03:56.112932 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:03:56.113301 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:03:56.147733 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:03:56.150041 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Marking volume 7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:03:56.166556 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to 7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 21:03:56.166986 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Creating volume glance metadata for volume 7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 21:03:56.319243 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36a369d-3efb-461c-a238-8ba79c266644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:56.327591 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd26325-51e9-4e69-bd6d-8e300022b1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:03:56.355673 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Volume volume-7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d (7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d): created successfully Dec 11 21:03:56.359992 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd26325-51e9-4e69-bd6d-8e300022b1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:03:56.371487 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Flow 'volume_create_manager' (ae339618-cbc8-40d2-a08a-3c23e1483783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:03:56.390512 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-cb5f1f90-78d5-4f1d-b975-bcafa11963ef tempest-TestVolumeBackupRestore-1162231384 None] Created volume successfully. Dec 11 21:04:00.554236 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-c7fbea7c-0edb-4326-b847-f101d51707a3 tempest-TestVolumeBackupRestore-1162231384 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:04:01.787121 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-c7fbea7c-0edb-4326-b847-f101d51707a3 tempest-TestVolumeBackupRestore-1162231384 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.232s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:04:01.788725 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7fbea7c-0edb-4326-b847-f101d51707a3 tempest-TestVolumeBackupRestore-1162231384 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:04:01.808057 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c7fbea7c-0edb-4326-b847-f101d51707a3 tempest-TestVolumeBackupRestore-1162231384 None] Initialize volume connection completed successfully. Dec 11 21:04:14.164892 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c7fbea7c-0edb-4326-b847-f101d51707a3 tempest-TestVolumeBackupRestore-1162231384 None] Terminate volume connection completed successfully. Dec 11 21:04:14.229025 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c7fbea7c-0edb-4326-b847-f101d51707a3 tempest-TestVolumeBackupRestore-1162231384 None] Remove volume export completed successfully. Dec 11 21:04:15.470323 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:04:15.477615 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:04:15.478128 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:04:15.524131 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Flow 'volume_create_manager' (47d00550-c976-4bb3-a01c-b1c189b6ebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:04:15.527535 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f537a1d-6534-42bd-8530-4bb3f1704447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:15.540391 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:04:15.564354 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f537a1d-6534-42bd-8530-4bb3f1704447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:04:15Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_750f3b0c-4514-4200-82f6-5f96dd472cdc',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1db74c9b-76be-4978-a8ac-3b6cb127fc26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e91091650141658a6c126a3884f5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:04:15Z,use_quota=True,user_id='7af4a401395b425fb07a24a603bb617f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:15.569475 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749e2fbb-cd5d-42b2-87e9-10387aaf0e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:15.580502 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749e2fbb-cd5d-42b2-87e9-10387aaf0e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:15.591877 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f086cd3-8802-4e90-a582-01fa0d4b72e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:15.594416 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f086cd3-8802-4e90-a582-01fa0d4b72e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1db74c9b-76be-4978-a8ac-3b6cb127fc26', 'volume_name': 'volume-1db74c9b-76be-4978-a8ac-3b6cb127fc26', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:15.598962 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5e4f24-76de-42cc-8963-87a98822e9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:15.619429 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5e4f24-76de-42cc-8963-87a98822e9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:15.625440 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86315c3f-0859-4372-95e9-5df7abcced1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:15.630401 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Volume 1db74c9b-76be-4978-a8ac-3b6cb127fc26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1db74c9b-76be-4978-a8ac-3b6cb127fc26', 'volume_size': 1} Dec 11 21:04:15.633195 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] creating volume 'volume-1db74c9b-76be-4978-a8ac-3b6cb127fc26' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:04:15.638666 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:15.793105 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:04:15.793484 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:04:15.795545 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86315c3f-0859-4372-95e9-5df7abcced1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db74c9b-76be-4978-a8ac-3b6cb127fc26', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:15.797740 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1efed55-a735-4e82-af49-6d03e37e1ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:15.820918 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Volume volume-1db74c9b-76be-4978-a8ac-3b6cb127fc26 (1db74c9b-76be-4978-a8ac-3b6cb127fc26): created successfully Dec 11 21:04:15.822977 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1efed55-a735-4e82-af49-6d03e37e1ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:15.826049 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Flow 'volume_create_manager' (47d00550-c976-4bb3-a01c-b1c189b6ebfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:04:15.847213 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Created volume successfully. Dec 11 21:04:16.850607 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:04:17.872832 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.022s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:04:17.873634 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1db74c9b-76be-4978-a8ac-3b6cb127fc26', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '1db74c9b-76be-4978-a8ac-3b6cb127fc26', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:04:17.894086 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Initialize volume connection completed successfully. Dec 11 21:04:18.861291 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:04:18.869031 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:04:18.870085 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:04:18.888289 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Flow 'volume_create_manager' (32198774-5f4c-4e6b-8120-796b0d499714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:04:18.896053 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7df3c0-3127-431b-860c-186176d39291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:18.916350 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:04:18.961829 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7df3c0-3127-431b-860c-186176d39291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1545304655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bce9fc9af38494fab218dfc63616ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:04:19Z,use_quota=True,user_id='b009aedcba2d42a0bafa758c15e68131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:18.969545 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50327a0c-e871-404b-a22c-07b06ede3f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:18.974211 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50327a0c-e871-404b-a22c-07b06ede3f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:18.978463 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad32783-7494-48ac-8427-733eb65c5e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:19.160895 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad32783-7494-48ac-8427-733eb65c5e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4cf6c7f-0e5a-4771-9c00-a456ed9aee8f', 'volume_name': 'volume-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:19.164597 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029484a4-5ca3-4a6f-b170-46154acb8c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:19.167804 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029484a4-5ca3-4a6f-b170-46154acb8c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:19.171545 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281a5d5f-1108-4f1e-bea3-9a47a8140316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:19.173068 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Volume d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 21:04:19.174228 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Cloning d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 21:04:19.187509 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:04:19.213431 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 4, 19, 196159)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:04:19.214327 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:04:19.220699 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 21:04:19.241025 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.053s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:04:19.242353 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 21:04:19.252848 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 4, 19, 247786)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:04:19.253618 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:04:19.254194 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 21:04:19.283156 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:19.541192 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] creating snapshot='volume-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:04:20.007906 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f.clone_snap' to 'volume-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:04:20.708353 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:04:20.710055 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:04:20.711417 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:04:20.819669 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:04:20.820864 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Marking volume d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:04:20.833940 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 21:04:20.835806 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Creating volume glance metadata for volume d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 21:04:20.927334 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281a5d5f-1108-4f1e-bea3-9a47a8140316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:20.930290 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3d08ca-ff96-48d8-b789-465152142f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:20.948765 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Volume volume-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f (d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f): created successfully Dec 11 21:04:20.950957 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3d08ca-ff96-48d8-b789-465152142f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:20.963357 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Flow 'volume_create_manager' (32198774-5f4c-4e6b-8120-796b0d499714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:04:20.976599 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7bb91cbe-7c2d-4d97-b4ed-ec847ee13cb1 tempest-ServersTestBootFromVolume-308351442 None] Created volume successfully. Dec 11 21:04:24.293199 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Terminate volume connection completed successfully. Dec 11 21:04:24.312120 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b73ee75c-e34a-411b-844d-f5c0cf3df303 tempest-TestVolumeBackupRestore-1162231384 None] Remove volume export completed successfully. Dec 11 21:04:24.757672 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-11e5f862-6667-4a1c-9448-590f56ee8bff req-c14eb280-4101-49a4-97b9-e53b82a37be4 tempest-ServersTestBootFromVolume-308351442 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:04:25.685340 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-11e5f862-6667-4a1c-9448-590f56ee8bff req-c14eb280-4101-49a4-97b9-e53b82a37be4 tempest-ServersTestBootFromVolume-308351442 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.927s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:04:25.687000 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-11e5f862-6667-4a1c-9448-590f56ee8bff req-c14eb280-4101-49a4-97b9-e53b82a37be4 tempest-ServersTestBootFromVolume-308351442 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'd4cf6c7f-0e5a-4771-9c00-a456ed9aee8f', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:04:25.737578 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-11e5f862-6667-4a1c-9448-590f56ee8bff req-c14eb280-4101-49a4-97b9-e53b82a37be4 tempest-ServersTestBootFromVolume-308351442 None] Connection info returned from driver {'name': 'volumes/volume-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd4cf6c7f-0e5a-4771-9c00-a456ed9aee8f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e89959a4-bdd1-4e97-bbca-50089fb87323'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:04:25.840993 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-11e5f862-6667-4a1c-9448-590f56ee8bff req-c14eb280-4101-49a4-97b9-e53b82a37be4 tempest-ServersTestBootFromVolume-308351442 None] attachment_update completed successfully. Dec 11 21:04:29.473965 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:04:29.480754 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:04:29.481620 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:04:29.497951 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Flow 'volume_create_manager' (d53911b7-5618-44c9-af76-7c5f2e27e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:04:29.502976 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7dcb9c-0ef5-43c0-ad30-9acac70434a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:29.510780 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:04:29.533397 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7dcb9c-0ef5-43c0-ad30-9acac70434a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1148413296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d0a3b3f6-3a92-444c-a624-670dd03859f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75debca7efe44eae8fb0322fee14cfcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:04:29Z,use_quota=True,user_id='4e692d20d3ee4a03b22f95b8d4ce4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:29.537298 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fd5b34-e887-432f-ac1f-bde2c05f170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:29.540452 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fd5b34-e887-432f-ac1f-bde2c05f170f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:29.546998 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05423c3-0674-494e-8148-57d4f2cbdc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:29.551943 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05423c3-0674-494e-8148-57d4f2cbdc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a3b3f6-3a92-444c-a624-670dd03859f9', 'volume_name': 'volume-d0a3b3f6-3a92-444c-a624-670dd03859f9', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:29.554587 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b75371-bbad-438a-9393-1b0b5cae7ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:29.562440 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b75371-bbad-438a-9393-1b0b5cae7ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:29.565951 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86915920-e8c0-48d9-a914-140c050e7ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:29.571553 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Volume d0a3b3f6-3a92-444c-a624-670dd03859f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a3b3f6-3a92-444c-a624-670dd03859f9', 'volume_size': 1} Dec 11 21:04:29.571972 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] creating volume 'volume-d0a3b3f6-3a92-444c-a624-670dd03859f9' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:04:29.573657 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:29.672805 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:04:29.673965 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:04:29.681550 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86915920-e8c0-48d9-a914-140c050e7ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a3b3f6-3a92-444c-a624-670dd03859f9', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:29.684929 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced9e1a7-720d-494c-9866-2543f118601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:04:29.701397 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Volume volume-d0a3b3f6-3a92-444c-a624-670dd03859f9 (d0a3b3f6-3a92-444c-a624-670dd03859f9): created successfully Dec 11 21:04:29.704122 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced9e1a7-720d-494c-9866-2543f118601d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:04:29.708613 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Flow 'volume_create_manager' (d53911b7-5618-44c9-af76-7c5f2e27e773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:04:29.723204 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c95c7332-2e64-4327-8130-270e2198a50c tempest-SnapshotsActionsTest-1253319703 None] Created volume successfully. Dec 11 21:04:30.723154 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf49f87b-b5d7-4631-a5d7-44dc4d0da884 tempest-SnapshotsActionsTest-1253319703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:31.937075 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-bf49f87b-b5d7-4631-a5d7-44dc4d0da884 tempest-SnapshotsActionsTest-1253319703 None] Create snapshot completed successfully Dec 11 21:04:32.285630 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-d70ef7bd-0005-4472-9d2c-2ca905a871cf req-e25cea7c-e127-4b07-b5af-c225c86f8d1e tempest-TestVolumeBackupRestore-1162231384 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:04:33.132500 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-d70ef7bd-0005-4472-9d2c-2ca905a871cf req-e25cea7c-e127-4b07-b5af-c225c86f8d1e tempest-TestVolumeBackupRestore-1162231384 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.847s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:04:33.133496 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-d70ef7bd-0005-4472-9d2c-2ca905a871cf req-e25cea7c-e127-4b07-b5af-c225c86f8d1e tempest-TestVolumeBackupRestore-1162231384 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1db74c9b-76be-4978-a8ac-3b6cb127fc26', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '1db74c9b-76be-4978-a8ac-3b6cb127fc26', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:04:33.200070 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-d70ef7bd-0005-4472-9d2c-2ca905a871cf req-e25cea7c-e127-4b07-b5af-c225c86f8d1e tempest-TestVolumeBackupRestore-1162231384 None] Connection info returned from driver {'name': 'volumes/volume-1db74c9b-76be-4978-a8ac-3b6cb127fc26', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1db74c9b-76be-4978-a8ac-3b6cb127fc26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bec8005f-7c30-44b8-a6a3-ba20cb6bd54a'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:04:33.325297 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-d70ef7bd-0005-4472-9d2c-2ca905a871cf req-e25cea7c-e127-4b07-b5af-c225c86f8d1e tempest-TestVolumeBackupRestore-1162231384 None] attachment_update completed successfully. Dec 11 21:04:33.593183 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8c62df43-d614-4e62-870c-e41f41867509 tempest-SnapshotsActionsTest-1253319703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:33.996183 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8c62df43-d614-4e62-870c-e41f41867509 tempest-SnapshotsActionsTest-1253319703 None] Create snapshot completed successfully Dec 11 21:04:34.855429 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-2305114a-3ba0-4f0a-b3fd-719aaffde2af tempest-SnapshotsActionsTest-137882153 None] Lock "b'cinder-74f31d49-66e8-44d7-9b3a-8c075205438b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:04:34.864753 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2305114a-3ba0-4f0a-b3fd-719aaffde2af tempest-SnapshotsActionsTest-137882153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:36.114263 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-2305114a-3ba0-4f0a-b3fd-719aaffde2af tempest-SnapshotsActionsTest-137882153 None] Created reservations ['e37dc378-fae4-43d1-b582-e53ec1eec0de', '1502b5b3-60c8-4457-906d-a21e7890051f', 'a9b17d66-64fe-4ae6-97f1-94ba2aae789e', '8fd8da7d-cc93-4b7d-bbef-2a4c8a30b99d'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:04:36.173837 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-2305114a-3ba0-4f0a-b3fd-719aaffde2af tempest-SnapshotsActionsTest-137882153 None] Delete snapshot completed successfully. Dec 11 21:04:36.180250 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-2305114a-3ba0-4f0a-b3fd-719aaffde2af tempest-SnapshotsActionsTest-137882153 None] Lock "b'cinder-74f31d49-66e8-44d7-9b3a-8c075205438b-delete_snapshot'" released by "delete_snapshot" :: held 1.325s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:04:37.496236 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b69e6039-bd44-4c2a-a5ab-bf4e88590ac4 tempest-SnapshotsActionsTest-1253319703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:38.137558 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b69e6039-bd44-4c2a-a5ab-bf4e88590ac4 tempest-SnapshotsActionsTest-1253319703 None] Create snapshot completed successfully Dec 11 21:04:38.919897 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-3f3d82a4-a238-4416-abfd-02765e60c572 tempest-SnapshotsActionsTest-137882153 None] Lock "b'cinder-b9894e77-996a-4107-a5c9-75bd65ca55e4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:04:38.926517 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3f3d82a4-a238-4416-abfd-02765e60c572 tempest-SnapshotsActionsTest-137882153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:40.219439 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-3f3d82a4-a238-4416-abfd-02765e60c572 tempest-SnapshotsActionsTest-137882153 None] Created reservations ['31b67e15-5517-4ad0-948c-4affed2fe07b', '107880bc-6ba7-4fe6-937c-067b8d9a2af6', '8c1fc3c9-5aaf-4c58-ae6b-f5430e20b0b4', 'ac35139f-0404-4a5e-8f36-dd931123ff03'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:04:40.342938 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-3f3d82a4-a238-4416-abfd-02765e60c572 tempest-SnapshotsActionsTest-137882153 None] Delete snapshot completed successfully. Dec 11 21:04:40.348706 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-3f3d82a4-a238-4416-abfd-02765e60c572 tempest-SnapshotsActionsTest-137882153 None] Lock "b'cinder-b9894e77-996a-4107-a5c9-75bd65ca55e4-delete_snapshot'" released by "delete_snapshot" :: held 1.429s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:04:41.536732 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-db1efda6-6124-477e-9f75-2910784c6af3 tempest-SnapshotsActionsTest-1253319703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:41.956538 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-db1efda6-6124-477e-9f75-2910784c6af3 tempest-SnapshotsActionsTest-1253319703 None] Create snapshot completed successfully Dec 11 21:04:42.823226 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-91897e0b-9694-42f2-a57e-e311b98b9930 tempest-SnapshotsActionsTest-137882153 None] Lock "b'cinder-7539dd4e-82ce-4cf1-b092-393b15aefdb3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:04:42.828018 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-91897e0b-9694-42f2-a57e-e311b98b9930 tempest-SnapshotsActionsTest-137882153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:44.041423 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-91897e0b-9694-42f2-a57e-e311b98b9930 tempest-SnapshotsActionsTest-137882153 None] Created reservations ['3df8fa45-0f16-474d-ba50-233e42d7d354', 'c32cb93e-236d-4984-8e37-ba6449397396', '6fa7fb4d-e484-46a1-aced-7696b70a9fca', '23431055-5c6b-4993-8041-2fb589994665'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:04:44.127347 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-91897e0b-9694-42f2-a57e-e311b98b9930 tempest-SnapshotsActionsTest-137882153 None] Delete snapshot completed successfully. Dec 11 21:04:44.137751 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-91897e0b-9694-42f2-a57e-e311b98b9930 tempest-SnapshotsActionsTest-137882153 None] Lock "b'cinder-7539dd4e-82ce-4cf1-b092-393b15aefdb3-delete_snapshot'" released by "delete_snapshot" :: held 1.315s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:04:45.476519 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-97e31643-50d8-4ca2-b983-c24750814498 tempest-SnapshotsActionsTest-1253319703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:46.013601 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-97e31643-50d8-4ca2-b983-c24750814498 tempest-SnapshotsActionsTest-1253319703 None] Create snapshot completed successfully Dec 11 21:04:46.740409 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-ec08f076-0235-4a57-917f-8de8329c1a39 tempest-SnapshotsActionsTest-137882153 None] Lock "b'cinder-17894f06-2114-42fc-82c9-c89aec36880d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.022s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:04:46.747529 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ec08f076-0235-4a57-917f-8de8329c1a39 tempest-SnapshotsActionsTest-137882153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:48.223820 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-ec08f076-0235-4a57-917f-8de8329c1a39 tempest-SnapshotsActionsTest-137882153 None] Created reservations ['b223b3e3-595c-40ef-b320-ce222e597204', '2e0501dc-d2d3-432c-95dd-0eea3151c116', '0d3f8070-2d53-428e-bfe9-bfc2df9f186b', 'd3cb0081-c96e-472a-962f-4fcb51851c3f'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:04:48.307226 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ec08f076-0235-4a57-917f-8de8329c1a39 tempest-SnapshotsActionsTest-137882153 None] Delete snapshot completed successfully. Dec 11 21:04:48.313157 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-ec08f076-0235-4a57-917f-8de8329c1a39 tempest-SnapshotsActionsTest-137882153 None] Lock "b'cinder-17894f06-2114-42fc-82c9-c89aec36880d-delete_snapshot'" released by "delete_snapshot" :: held 1.573s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:04:49.828065 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-0035f2b4-6cf4-4b97-ba99-b18051029c1f tempest-SnapshotsActionsTest-1253319703 None] Lock "b'cinder-73a0ad42-93c2-4b56-81d4-3a5c0e2ba031-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:04:49.833284 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0035f2b4-6cf4-4b97-ba99-b18051029c1f tempest-SnapshotsActionsTest-1253319703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:50.272637 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-0035f2b4-6cf4-4b97-ba99-b18051029c1f tempest-SnapshotsActionsTest-1253319703 None] Created reservations ['9857fb22-77b0-43b7-bde9-dec40ebdb303', 'c4bf64b5-0d15-42d6-967e-dac7f846b4d6', '009a8507-1c4f-41d0-9d8e-e3b8f06bd962', '97844fd7-2642-4d4f-8d14-e78a3dea3678'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:04:50.387802 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-0035f2b4-6cf4-4b97-ba99-b18051029c1f tempest-SnapshotsActionsTest-1253319703 None] Delete snapshot completed successfully. Dec 11 21:04:50.395021 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-0035f2b4-6cf4-4b97-ba99-b18051029c1f tempest-SnapshotsActionsTest-1253319703 None] Lock "b'cinder-73a0ad42-93c2-4b56-81d4-3a5c0e2ba031-delete_snapshot'" released by "delete_snapshot" :: held 0.569s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:04:50.988050 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7861b324-27f3-4131-babb-26f2be2325cf tempest-SnapshotsActionsTest-1253319703 None] Lock "b'cinder-d0a3b3f6-3a92-444c-a624-670dd03859f9-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:04:51.050178 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7861b324-27f3-4131-babb-26f2be2325cf tempest-SnapshotsActionsTest-1253319703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:51.186015 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7861b324-27f3-4131-babb-26f2be2325cf tempest-SnapshotsActionsTest-1253319703 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:04:51.187131 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7861b324-27f3-4131-babb-26f2be2325cf tempest-SnapshotsActionsTest-1253319703 None] Volume volume-d0a3b3f6-3a92-444c-a624-670dd03859f9 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:04:51.199691 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7861b324-27f3-4131-babb-26f2be2325cf tempest-SnapshotsActionsTest-1253319703 None] deleting rbd volume volume-d0a3b3f6-3a92-444c-a624-670dd03859f9 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:04:51.799795 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-7861b324-27f3-4131-babb-26f2be2325cf tempest-SnapshotsActionsTest-1253319703 None] Created reservations ['bcc1f381-ded4-49a1-bb70-887aefb22d66', 'c7a344e1-a359-4ccb-a20b-331588526ed7', 'e38651ac-d7d7-45cd-ab02-70d80e447d94', 'b2a87b35-bdfa-44db-963b-c2d29cdba954'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:04:51.882186 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7861b324-27f3-4131-babb-26f2be2325cf tempest-SnapshotsActionsTest-1253319703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:51.969996 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7861b324-27f3-4131-babb-26f2be2325cf tempest-SnapshotsActionsTest-1253319703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:52.037593 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7861b324-27f3-4131-babb-26f2be2325cf tempest-SnapshotsActionsTest-1253319703 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:04:52.043548 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7861b324-27f3-4131-babb-26f2be2325cf tempest-SnapshotsActionsTest-1253319703 None] Deleted volume successfully. Dec 11 21:04:52.070514 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7861b324-27f3-4131-babb-26f2be2325cf tempest-SnapshotsActionsTest-1253319703 None] Lock "b'cinder-d0a3b3f6-3a92-444c-a624-670dd03859f9-delete_volume'" released by "delete_volume" :: held 1.082s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:04:55.842946 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:04:55.844887 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:55.900625 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:04:55.954978 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:05:04.278374 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:05:04.283719 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:05:04.284199 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:05:04.311123 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Flow 'volume_create_manager' (8912b575-672d-40fe-9c58-041f543c8304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:05:04.315140 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2905d627-9649-4de8-93ee-50f4585094f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:04.324053 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:05:04.348995 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2905d627-9649-4de8-93ee-50f4585094f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1602920339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=eb81d485-b67a-406b-85b9-78857b64e343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16ded049bc4463db2ac516fa665cd3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:05:04Z,use_quota=True,user_id='5546c440c6d244ffb678900a8bf5e710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:04.354326 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615242a8-646d-4318-a0d7-60daf2a6b343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:04.356970 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615242a8-646d-4318-a0d7-60daf2a6b343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:04.361491 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87599f3d-8b0e-49b1-9600-2080924c8fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:04.364688 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87599f3d-8b0e-49b1-9600-2080924c8fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb81d485-b67a-406b-85b9-78857b64e343', 'volume_name': 'volume-eb81d485-b67a-406b-85b9-78857b64e343', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:04.374351 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914f24d6-4960-408e-b546-8a06cb272d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:04.377162 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914f24d6-4960-408e-b546-8a06cb272d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:04.384083 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5aa5c7e-54f0-428d-a138-b8382db9b9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:04.385679 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Volume eb81d485-b67a-406b-85b9-78857b64e343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb81d485-b67a-406b-85b9-78857b64e343', 'volume_size': 1} Dec 11 21:05:04.386083 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] creating volume 'volume-eb81d485-b67a-406b-85b9-78857b64e343' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:05:04.389471 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:04.551119 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:05:04.552047 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:05:04.558249 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5aa5c7e-54f0-428d-a138-b8382db9b9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb81d485-b67a-406b-85b9-78857b64e343', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:04.564217 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b434511-79f4-4ed8-944f-c7229f3238b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:04.579251 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Volume volume-eb81d485-b67a-406b-85b9-78857b64e343 (eb81d485-b67a-406b-85b9-78857b64e343): created successfully Dec 11 21:05:04.581306 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b434511-79f4-4ed8-944f-c7229f3238b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:04.584673 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Flow 'volume_create_manager' (8912b575-672d-40fe-9c58-041f543c8304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:05:04.595780 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-5d5e3d29-102f-4801-bcf8-cecb011cc74d tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Created volume successfully. Dec 11 21:05:06.787656 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-a698bc60-1cdc-40be-8cfe-d96a8c7e34ff tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Lock "b'cinder-eb81d485-b67a-406b-85b9-78857b64e343-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:05:06.851646 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a698bc60-1cdc-40be-8cfe-d96a8c7e34ff tempest-VolumeQuotasNegativeTestJSON-1158831787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:06.959203 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a698bc60-1cdc-40be-8cfe-d96a8c7e34ff tempest-VolumeQuotasNegativeTestJSON-1158831787 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:05:06.959935 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a698bc60-1cdc-40be-8cfe-d96a8c7e34ff tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Volume volume-eb81d485-b67a-406b-85b9-78857b64e343 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:05:06.984456 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a698bc60-1cdc-40be-8cfe-d96a8c7e34ff tempest-VolumeQuotasNegativeTestJSON-1158831787 None] deleting rbd volume volume-eb81d485-b67a-406b-85b9-78857b64e343 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:05:07.641009 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-a698bc60-1cdc-40be-8cfe-d96a8c7e34ff tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Created reservations ['b775f6d4-8091-41e4-9ac8-bacc9a96ac50', 'ff724bf2-8524-41ac-92fb-165f4cbbad25', '5da1e0a7-95eb-443a-a481-cd79dd2eb819', '599d9b95-c5a4-4840-8304-9b673e245b52'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:05:07.730745 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a698bc60-1cdc-40be-8cfe-d96a8c7e34ff tempest-VolumeQuotasNegativeTestJSON-1158831787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:07.781287 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a698bc60-1cdc-40be-8cfe-d96a8c7e34ff tempest-VolumeQuotasNegativeTestJSON-1158831787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:07.851567 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-a698bc60-1cdc-40be-8cfe-d96a8c7e34ff tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:05:07.858003 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-a698bc60-1cdc-40be-8cfe-d96a8c7e34ff tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Deleted volume successfully. Dec 11 21:05:07.888784 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-a698bc60-1cdc-40be-8cfe-d96a8c7e34ff tempest-VolumeQuotasNegativeTestJSON-1158831787 None] Lock "b'cinder-eb81d485-b67a-406b-85b9-78857b64e343-delete_volume'" released by "delete_volume" :: held 1.102s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:05:13.334626 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-f1b92f18-afe5-4678-bc6e-b74fe56abf00 req-33294519-35cf-4e84-a361-478cb1eb89ba tempest-TaggedBootDevicesTest-262552579 None] Terminate volume connection completed successfully. Dec 11 21:05:13.335136 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-f1b92f18-afe5-4678-bc6e-b74fe56abf00 req-33294519-35cf-4e84-a361-478cb1eb89ba tempest-TaggedBootDevicesTest-262552579 None] Deleting attachment 8360860a-5547-4187-ad32-9204ba15d12b. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:05:13.496104 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-f1b92f18-afe5-4678-bc6e-b74fe56abf00 req-0728b999-3541-4946-8763-fb92cfd8e805 tempest-TaggedBootDevicesTest-262552579 None] Terminate volume connection completed successfully. Dec 11 21:05:13.503337 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-f1b92f18-afe5-4678-bc6e-b74fe56abf00 req-0728b999-3541-4946-8763-fb92cfd8e805 tempest-TaggedBootDevicesTest-262552579 None] Deleting attachment 570d3517-3d9f-4e59-a903-44b992c61c46. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:05:13.548454 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:05:13.561786 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:05:13.566037 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:05:13.608564 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Flow 'volume_create_manager' (5ce8d874-2a3a-4dc6-a19a-2f7b54e4dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:05:13.617473 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2d0e15-19d3-4f80-a447-86f586d09d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:13.628171 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:05:13.648573 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2d0e15-19d3-4f80-a447-86f586d09d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-631711573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=eadf804a-f17e-4ea4-b992-c925e6e57a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30101a03df8c4d1599b9f030e4263b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:05:13Z,use_quota=True,user_id='2f224e4e7c8a42a2a9abbac05120113f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:13.653410 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630fbc54-bdba-4f79-a14e-618b45c7488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:13.655837 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630fbc54-bdba-4f79-a14e-618b45c7488c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:13.658426 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8486d0b9-b37a-4272-ab00-5485ce89a82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:13.661885 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8486d0b9-b37a-4272-ab00-5485ce89a82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eadf804a-f17e-4ea4-b992-c925e6e57a8e', 'volume_name': 'volume-eadf804a-f17e-4ea4-b992-c925e6e57a8e', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:13.664612 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4a0259-e2c5-4473-b0dc-f0fb12932c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:13.667588 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4a0259-e2c5-4473-b0dc-f0fb12932c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:13.670192 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb290e8-80bd-4ec5-909c-0b6386a76b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:13.671311 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Volume eadf804a-f17e-4ea4-b992-c925e6e57a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eadf804a-f17e-4ea4-b992-c925e6e57a8e', 'volume_size': 1} Dec 11 21:05:13.671992 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] creating volume 'volume-eadf804a-f17e-4ea4-b992-c925e6e57a8e' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:05:13.673225 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:13.734871 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-f1b92f18-afe5-4678-bc6e-b74fe56abf00 req-2f53cc92-df30-48c4-bd48-264a97afe435 tempest-TaggedBootDevicesTest-262552579 None] Terminate volume connection completed successfully. Dec 11 21:05:13.735730 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-f1b92f18-afe5-4678-bc6e-b74fe56abf00 req-2f53cc92-df30-48c4-bd48-264a97afe435 tempest-TaggedBootDevicesTest-262552579 None] Deleting attachment caac856b-6437-4c56-a290-502005821828. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:05:13.823816 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:05:13.824618 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:05:13.827054 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb290e8-80bd-4ec5-909c-0b6386a76b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eadf804a-f17e-4ea4-b992-c925e6e57a8e', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:13.829569 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe43e617-c64b-4188-99b9-d12b969795df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:13.845903 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Volume volume-eadf804a-f17e-4ea4-b992-c925e6e57a8e (eadf804a-f17e-4ea4-b992-c925e6e57a8e): created successfully Dec 11 21:05:13.850223 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe43e617-c64b-4188-99b9-d12b969795df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:13.856560 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Flow 'volume_create_manager' (5ce8d874-2a3a-4dc6-a19a-2f7b54e4dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:05:13.871809 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ccea1964-270c-4327-9b21-6c481c888a2d tempest-VolumesBackupsAdminTest-953270115 None] Created volume successfully. Dec 11 21:05:15.063232 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-42b6b6d5-3e80-4ea5-bb32-bab57e9993db tempest-VolumesBackupsAdminTest-953270115 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:05:16.182091 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-42b6b6d5-3e80-4ea5-bb32-bab57e9993db tempest-VolumesBackupsAdminTest-953270115 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.119s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:05:16.183697 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-42b6b6d5-3e80-4ea5-bb32-bab57e9993db tempest-VolumesBackupsAdminTest-953270115 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-eadf804a-f17e-4ea4-b992-c925e6e57a8e', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'eadf804a-f17e-4ea4-b992-c925e6e57a8e', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:05:16.229379 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-42b6b6d5-3e80-4ea5-bb32-bab57e9993db tempest-VolumesBackupsAdminTest-953270115 None] Initialize volume connection completed successfully. Dec 11 21:05:19.006995 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-42b6b6d5-3e80-4ea5-bb32-bab57e9993db tempest-VolumesBackupsAdminTest-953270115 None] Terminate volume connection completed successfully. Dec 11 21:05:19.038387 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-42b6b6d5-3e80-4ea5-bb32-bab57e9993db tempest-VolumesBackupsAdminTest-953270115 None] Remove volume export completed successfully. Dec 11 21:05:22.049722 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-6c31ceba-1562-406b-9347-8c6ce0e28290 tempest-TaggedBootDevicesTest-262552579 None] Lock "b'cinder-063ad756-f8f1-422c-8ef8-c139a6abdaf5-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:05:22.124569 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6c31ceba-1562-406b-9347-8c6ce0e28290 tempest-TaggedBootDevicesTest-262552579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:22.227950 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6c31ceba-1562-406b-9347-8c6ce0e28290 tempest-TaggedBootDevicesTest-262552579 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:05:22.228496 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6c31ceba-1562-406b-9347-8c6ce0e28290 tempest-TaggedBootDevicesTest-262552579 None] Volume volume-063ad756-f8f1-422c-8ef8-c139a6abdaf5 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:05:22.251368 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6c31ceba-1562-406b-9347-8c6ce0e28290 tempest-TaggedBootDevicesTest-262552579 None] deleting rbd volume volume-063ad756-f8f1-422c-8ef8-c139a6abdaf5 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:05:22.360078 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:05:22.366712 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:05:22.367230 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:05:22.384452 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Flow 'volume_create_manager' (e4f96a3e-c70e-4a89-836c-74f2ed197297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:05:22.389146 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5301f8f-dbb5-4ad7-b301-41b04a78488f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:22.396543 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:05:22.421894 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5301f8f-dbb5-4ad7-b301-41b04a78488f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:05:22Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_ad504e7d-6609-46da-9e6d-d50578f9abe2',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b7db60e7-b0d8-41c9-9119-7101f0a2232d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30101a03df8c4d1599b9f030e4263b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:05:22Z,use_quota=True,user_id='2f224e4e7c8a42a2a9abbac05120113f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:22.425395 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4fce879-a1c8-4994-a81c-73e52b5ef4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:22.428426 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4fce879-a1c8-4994-a81c-73e52b5ef4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:22.431915 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abcaa59-e914-45f2-a67e-9aaf0b3527ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:22.437746 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abcaa59-e914-45f2-a67e-9aaf0b3527ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7db60e7-b0d8-41c9-9119-7101f0a2232d', 'volume_name': 'volume-b7db60e7-b0d8-41c9-9119-7101f0a2232d', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:22.440706 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c2822a-9a98-4b38-ba4b-025311bf0b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:22.443614 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c2822a-9a98-4b38-ba4b-025311bf0b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:22.448520 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68484d7-bd05-40fb-b69e-d62fb700fcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:22.450091 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Volume b7db60e7-b0d8-41c9-9119-7101f0a2232d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7db60e7-b0d8-41c9-9119-7101f0a2232d', 'volume_size': 1} Dec 11 21:05:22.450797 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] creating volume 'volume-b7db60e7-b0d8-41c9-9119-7101f0a2232d' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:05:22.452187 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:22.574712 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:05:22.575647 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:05:22.581433 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68484d7-bd05-40fb-b69e-d62fb700fcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7db60e7-b0d8-41c9-9119-7101f0a2232d', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:22.584694 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707bc2a7-0e91-45f9-b213-172865821679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:22.607017 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Volume volume-b7db60e7-b0d8-41c9-9119-7101f0a2232d (b7db60e7-b0d8-41c9-9119-7101f0a2232d): created successfully Dec 11 21:05:22.612578 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707bc2a7-0e91-45f9-b213-172865821679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:22.616266 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Flow 'volume_create_manager' (e4f96a3e-c70e-4a89-836c-74f2ed197297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:05:22.630174 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Created volume successfully. Dec 11 21:05:22.756190 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-6c31ceba-1562-406b-9347-8c6ce0e28290 tempest-TaggedBootDevicesTest-262552579 None] Created reservations ['49434381-6841-4e50-a029-daf1b0de6bfd', 'dbb56331-a0f5-4c03-b4a2-aa397c7336db', 'e70cccfd-1222-4ba7-90a5-88e351e2050a', '74c19199-a67d-4965-aea3-5f4f66a9cef8'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:05:22.834176 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6c31ceba-1562-406b-9347-8c6ce0e28290 tempest-TaggedBootDevicesTest-262552579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:22.929208 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6c31ceba-1562-406b-9347-8c6ce0e28290 tempest-TaggedBootDevicesTest-262552579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:22.996523 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-6c31ceba-1562-406b-9347-8c6ce0e28290 tempest-TaggedBootDevicesTest-262552579 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:05:23.015735 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-6c31ceba-1562-406b-9347-8c6ce0e28290 tempest-TaggedBootDevicesTest-262552579 None] Deleted volume successfully. Dec 11 21:05:23.035842 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-6c31ceba-1562-406b-9347-8c6ce0e28290 tempest-TaggedBootDevicesTest-262552579 None] Lock "b'cinder-063ad756-f8f1-422c-8ef8-c139a6abdaf5-delete_volume'" released by "delete_volume" :: held 0.986s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:05:23.317216 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-70221c30-a635-40f3-8488-660a44b1e44d tempest-TaggedBootDevicesTest-262552579 None] Lock "b'cinder-c1dfe182-bb86-46fb-a3e2-803cc6c4178f-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:05:23.428160 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-70221c30-a635-40f3-8488-660a44b1e44d tempest-TaggedBootDevicesTest-262552579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:23.531977 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-70221c30-a635-40f3-8488-660a44b1e44d tempest-TaggedBootDevicesTest-262552579 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:05:23.532438 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-70221c30-a635-40f3-8488-660a44b1e44d tempest-TaggedBootDevicesTest-262552579 None] Volume volume-c1dfe182-bb86-46fb-a3e2-803cc6c4178f is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:05:23.549451 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-70221c30-a635-40f3-8488-660a44b1e44d tempest-TaggedBootDevicesTest-262552579 None] deleting rbd volume volume-c1dfe182-bb86-46fb-a3e2-803cc6c4178f {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:05:23.597685 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:05:24.092293 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-70221c30-a635-40f3-8488-660a44b1e44d tempest-TaggedBootDevicesTest-262552579 None] Created reservations ['a227de6e-066a-4443-9e47-2c4920ab1f0e', '439521c0-3f51-4461-9c78-ffca78035da1', 'a9fa53e3-0f3d-4f91-bed3-622b9d3d6726', '1ca86b31-a574-4b54-bd71-b21f410f55dd'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:05:24.146634 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-70221c30-a635-40f3-8488-660a44b1e44d tempest-TaggedBootDevicesTest-262552579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:24.184838 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-70221c30-a635-40f3-8488-660a44b1e44d tempest-TaggedBootDevicesTest-262552579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:24.263285 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-70221c30-a635-40f3-8488-660a44b1e44d tempest-TaggedBootDevicesTest-262552579 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:05:24.268365 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-70221c30-a635-40f3-8488-660a44b1e44d tempest-TaggedBootDevicesTest-262552579 None] Deleted volume successfully. Dec 11 21:05:24.294384 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-70221c30-a635-40f3-8488-660a44b1e44d tempest-TaggedBootDevicesTest-262552579 None] Lock "b'cinder-c1dfe182-bb86-46fb-a3e2-803cc6c4178f-delete_volume'" released by "delete_volume" :: held 0.977s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:05:24.411368 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.812s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:05:24.413594 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b7db60e7-b0d8-41c9-9119-7101f0a2232d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'b7db60e7-b0d8-41c9-9119-7101f0a2232d', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:05:24.459501 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Initialize volume connection completed successfully. Dec 11 21:05:24.592268 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c7e6b0a3-d4f8-49f6-b869-37ddc0af68f4 tempest-TaggedBootDevicesTest-262552579 None] Lock "b'cinder-a2771b04-1309-441b-b6e9-2c6b44964ee1-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:05:24.710036 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7e6b0a3-d4f8-49f6-b869-37ddc0af68f4 tempest-TaggedBootDevicesTest-262552579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:24.877699 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7e6b0a3-d4f8-49f6-b869-37ddc0af68f4 tempest-TaggedBootDevicesTest-262552579 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:05:24.902036 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7e6b0a3-d4f8-49f6-b869-37ddc0af68f4 tempest-TaggedBootDevicesTest-262552579 None] deleting rbd volume volume-a2771b04-1309-441b-b6e9-2c6b44964ee1 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:05:25.419842 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7e6b0a3-d4f8-49f6-b869-37ddc0af68f4 tempest-TaggedBootDevicesTest-262552579 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:05:25.458493 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7e6b0a3-d4f8-49f6-b869-37ddc0af68f4 tempest-TaggedBootDevicesTest-262552579 None] deleting parent snapshot volume-a2771b04-1309-441b-b6e9-2c6b44964ee1.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:05:26.022519 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-c7e6b0a3-d4f8-49f6-b869-37ddc0af68f4 tempest-TaggedBootDevicesTest-262552579 None] Created reservations ['969741ed-4d9a-4cc5-ba68-d4e4573243af', '21f1e101-60f2-4a92-b465-c40c6c9b9e20', 'ef28039a-c5a5-44db-a8c9-7d83bfbffee6', 'e1f0ccbf-8a60-45a0-aa4f-eb4191040741'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:05:26.091844 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7e6b0a3-d4f8-49f6-b869-37ddc0af68f4 tempest-TaggedBootDevicesTest-262552579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:26.140047 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7e6b0a3-d4f8-49f6-b869-37ddc0af68f4 tempest-TaggedBootDevicesTest-262552579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:26.175660 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-c7e6b0a3-d4f8-49f6-b869-37ddc0af68f4 tempest-TaggedBootDevicesTest-262552579 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:05:26.180997 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c7e6b0a3-d4f8-49f6-b869-37ddc0af68f4 tempest-TaggedBootDevicesTest-262552579 None] Deleted volume successfully. Dec 11 21:05:26.199842 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c7e6b0a3-d4f8-49f6-b869-37ddc0af68f4 tempest-TaggedBootDevicesTest-262552579 None] Lock "b'cinder-a2771b04-1309-441b-b6e9-2c6b44964ee1-delete_volume'" released by "delete_volume" :: held 1.607s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:05:26.230880 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Terminate volume connection completed successfully. Dec 11 21:05:26.251077 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-15f6d006-8fa7-412a-a50c-40ad11c3414c tempest-VolumesBackupsAdminTest-953270115 None] Remove volume export completed successfully. Dec 11 21:05:26.833199 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8a3be220-1520-40bf-b3bc-ae7eb85436ce tempest-VolumesBackupsAdminTest-953270115 None] Lock "b'cinder-b7db60e7-b0d8-41c9-9119-7101f0a2232d-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:05:26.900485 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8a3be220-1520-40bf-b3bc-ae7eb85436ce tempest-VolumesBackupsAdminTest-953270115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:27.997026 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8a3be220-1520-40bf-b3bc-ae7eb85436ce tempest-VolumesBackupsAdminTest-953270115 None] Volume volume-b7db60e7-b0d8-41c9-9119-7101f0a2232d is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:05:28.043325 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8a3be220-1520-40bf-b3bc-ae7eb85436ce tempest-VolumesBackupsAdminTest-953270115 None] deleting rbd volume volume-b7db60e7-b0d8-41c9-9119-7101f0a2232d {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:05:28.607835 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-8a3be220-1520-40bf-b3bc-ae7eb85436ce tempest-VolumesBackupsAdminTest-953270115 None] Created reservations ['5fa3498c-16d5-4cc6-8b03-58906e71da18', '1f8d9c0d-e868-4991-845b-47655b1ebd10', '7aaec07e-f857-4633-a99a-8f3377b63391', '18bdb0e4-7e6d-480e-a13c-d815892cd0df'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:05:28.692334 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8a3be220-1520-40bf-b3bc-ae7eb85436ce tempest-VolumesBackupsAdminTest-953270115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:28.759383 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8a3be220-1520-40bf-b3bc-ae7eb85436ce tempest-VolumesBackupsAdminTest-953270115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:28.812632 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-8a3be220-1520-40bf-b3bc-ae7eb85436ce tempest-VolumesBackupsAdminTest-953270115 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:05:28.837706 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8a3be220-1520-40bf-b3bc-ae7eb85436ce tempest-VolumesBackupsAdminTest-953270115 None] Deleted volume successfully. Dec 11 21:05:28.861357 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8a3be220-1520-40bf-b3bc-ae7eb85436ce tempest-VolumesBackupsAdminTest-953270115 None] Lock "b'cinder-b7db60e7-b0d8-41c9-9119-7101f0a2232d-delete_volume'" released by "delete_volume" :: held 2.028s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:05:30.902597 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:05:30.910138 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:05:30.911047 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:05:30.937701 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Flow 'volume_create_manager' (21577174-ce2f-47c5-866e-e709678807ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:05:30.951334 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a3f4c3-872c-426e-829c-1c9c7e6af80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:30.968840 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:05:31.007201 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a3f4c3-872c-426e-829c-1c9c7e6af80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-823945327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a3673216-b0df-4687-99ed-25ae706253c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30101a03df8c4d1599b9f030e4263b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:05:31Z,use_quota=True,user_id='2f224e4e7c8a42a2a9abbac05120113f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:31.010925 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b45cc2a-af8f-4e86-a346-08a575fc868a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:31.013694 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b45cc2a-af8f-4e86-a346-08a575fc868a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:31.017375 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbeeef1-6822-4b5b-b3a4-568bf600d42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:31.020778 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbeeef1-6822-4b5b-b3a4-568bf600d42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3673216-b0df-4687-99ed-25ae706253c1', 'volume_name': 'volume-a3673216-b0df-4687-99ed-25ae706253c1', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:31.023380 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1097e2-5870-4152-9279-da5b6b852496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:31.026677 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1097e2-5870-4152-9279-da5b6b852496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:31.034053 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f41f20-3dca-40d5-86ee-2cee89d45fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:31.035355 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Volume a3673216-b0df-4687-99ed-25ae706253c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3673216-b0df-4687-99ed-25ae706253c1', 'volume_size': 1} Dec 11 21:05:31.035960 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] creating volume 'volume-a3673216-b0df-4687-99ed-25ae706253c1' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:05:31.037535 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:31.229343 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:05:31.231528 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:05:31.247123 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f41f20-3dca-40d5-86ee-2cee89d45fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3673216-b0df-4687-99ed-25ae706253c1', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:31.256579 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06f760d-9c59-4cf4-a552-d2a38d1f8c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:31.289043 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Volume volume-a3673216-b0df-4687-99ed-25ae706253c1 (a3673216-b0df-4687-99ed-25ae706253c1): created successfully Dec 11 21:05:31.292521 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06f760d-9c59-4cf4-a552-d2a38d1f8c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:31.299787 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Flow 'volume_create_manager' (21577174-ce2f-47c5-866e-e709678807ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:05:31.326452 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b154c0d7-8051-4099-b4cc-e0191ee1924a tempest-VolumesBackupsAdminTest-953270115 None] Created volume successfully. Dec 11 21:05:32.251705 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-cd2acf9e-c3ca-4e36-bb97-00b244ac2a05 tempest-VolumesBackupsAdminTest-953270115 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:05:33.379137 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-cd2acf9e-c3ca-4e36-bb97-00b244ac2a05 tempest-VolumesBackupsAdminTest-953270115 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.127s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:05:33.380897 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cd2acf9e-c3ca-4e36-bb97-00b244ac2a05 tempest-VolumesBackupsAdminTest-953270115 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a3673216-b0df-4687-99ed-25ae706253c1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'a3673216-b0df-4687-99ed-25ae706253c1', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:05:33.402059 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-cd2acf9e-c3ca-4e36-bb97-00b244ac2a05 tempest-VolumesBackupsAdminTest-953270115 None] Initialize volume connection completed successfully. Dec 11 21:05:35.313211 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-cd2acf9e-c3ca-4e36-bb97-00b244ac2a05 tempest-VolumesBackupsAdminTest-953270115 None] Terminate volume connection completed successfully. Dec 11 21:05:35.334249 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-cd2acf9e-c3ca-4e36-bb97-00b244ac2a05 tempest-VolumesBackupsAdminTest-953270115 None] Remove volume export completed successfully. Dec 11 21:05:39.731337 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-cf10ab39-68b3-497f-b8ee-160070469779 tempest-VolumesBackupsAdminTest-953270115 None] Lock "b'cinder-a3673216-b0df-4687-99ed-25ae706253c1-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:05:39.808747 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cf10ab39-68b3-497f-b8ee-160070469779 tempest-VolumesBackupsAdminTest-953270115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:40.121467 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cf10ab39-68b3-497f-b8ee-160070469779 tempest-VolumesBackupsAdminTest-953270115 None] Volume volume-a3673216-b0df-4687-99ed-25ae706253c1 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:05:40.169055 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cf10ab39-68b3-497f-b8ee-160070469779 tempest-VolumesBackupsAdminTest-953270115 None] deleting rbd volume volume-a3673216-b0df-4687-99ed-25ae706253c1 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:05:40.798970 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-cf10ab39-68b3-497f-b8ee-160070469779 tempest-VolumesBackupsAdminTest-953270115 None] Created reservations ['75940680-f5b6-49b9-afec-5de8e740d8fa', '00c9e360-0e41-4ab4-ac33-ccfc9da6ce58', '7939c780-79ea-4394-9282-9e1f07d7ff83', '72da8b8d-32ab-4217-98ed-a5d81407c3fe'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:05:40.893506 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cf10ab39-68b3-497f-b8ee-160070469779 tempest-VolumesBackupsAdminTest-953270115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:41.004586 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cf10ab39-68b3-497f-b8ee-160070469779 tempest-VolumesBackupsAdminTest-953270115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:41.059271 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-cf10ab39-68b3-497f-b8ee-160070469779 tempest-VolumesBackupsAdminTest-953270115 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:05:41.069206 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-cf10ab39-68b3-497f-b8ee-160070469779 tempest-VolumesBackupsAdminTest-953270115 None] Deleted volume successfully. Dec 11 21:05:41.105607 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-54d97a70-18f0-4685-a9ce-23c0d6bc9ba5 tempest-VolumesBackupsAdminTest-953270115 None] Lock "b'cinder-eadf804a-f17e-4ea4-b992-c925e6e57a8e-delete_volume'" acquired by "delete_volume" :: waited 0.041s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:05:41.191808 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-cf10ab39-68b3-497f-b8ee-160070469779 tempest-VolumesBackupsAdminTest-953270115 None] Lock "b'cinder-a3673216-b0df-4687-99ed-25ae706253c1-delete_volume'" released by "delete_volume" :: held 1.460s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:05:41.220797 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-54d97a70-18f0-4685-a9ce-23c0d6bc9ba5 tempest-VolumesBackupsAdminTest-953270115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:41.933045 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-54d97a70-18f0-4685-a9ce-23c0d6bc9ba5 tempest-VolumesBackupsAdminTest-953270115 None] Volume volume-eadf804a-f17e-4ea4-b992-c925e6e57a8e is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:05:41.979132 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-54d97a70-18f0-4685-a9ce-23c0d6bc9ba5 tempest-VolumesBackupsAdminTest-953270115 None] deleting rbd volume volume-eadf804a-f17e-4ea4-b992-c925e6e57a8e {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:05:42.686150 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-54d97a70-18f0-4685-a9ce-23c0d6bc9ba5 tempest-VolumesBackupsAdminTest-953270115 None] Created reservations ['22b28188-7caa-4ad1-bd68-4b339d7d3f10', '1c220ccc-df86-44a7-8814-b6f4feee8767', '7d5d9c46-63d7-47e1-9fec-845f662c2a9c', '6034b4e7-9e54-4faf-b93b-9dff69679dea'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:05:42.774529 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-54d97a70-18f0-4685-a9ce-23c0d6bc9ba5 tempest-VolumesBackupsAdminTest-953270115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:42.843846 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-54d97a70-18f0-4685-a9ce-23c0d6bc9ba5 tempest-VolumesBackupsAdminTest-953270115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:42.920354 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-54d97a70-18f0-4685-a9ce-23c0d6bc9ba5 tempest-VolumesBackupsAdminTest-953270115 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:05:42.924419 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-54d97a70-18f0-4685-a9ce-23c0d6bc9ba5 tempest-VolumesBackupsAdminTest-953270115 None] Deleted volume successfully. Dec 11 21:05:42.940635 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-54d97a70-18f0-4685-a9ce-23c0d6bc9ba5 tempest-VolumesBackupsAdminTest-953270115 None] Lock "b'cinder-eadf804a-f17e-4ea4-b992-c925e6e57a8e-delete_volume'" released by "delete_volume" :: held 1.835s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:05:49.653135 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:05:49.666086 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:05:49.667037 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:05:49.696932 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Flow 'volume_create_manager' (8be3626f-455a-430a-92fc-bed18516d396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:05:49.703639 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948a48e1-31fd-401b-9d6a-ff36fad2718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:49.717268 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:05:49.746396 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948a48e1-31fd-401b-9d6a-ff36fad2718e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-634707632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2c77fd4-88b5-43fe-9d17-ef0b80b51639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21512a3d3bc54e479dc5709f143aae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:05:50Z,use_quota=True,user_id='51f0d1f341b24fa291bc6eba2d3bb966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:49.749482 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bbaaa4-5730-4bae-bd33-f1ab8c37d5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:49.753188 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bbaaa4-5730-4bae-bd33-f1ab8c37d5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:49.760769 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3c7e48-f946-451d-9e1c-e850dcb364e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:49.892139 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3c7e48-f946-451d-9e1c-e850dcb364e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2c77fd4-88b5-43fe-9d17-ef0b80b51639', 'volume_name': 'volume-b2c77fd4-88b5-43fe-9d17-ef0b80b51639', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:49.895696 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771d616e-e1fd-4845-9a7f-5af78adf2e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:49.902297 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771d616e-e1fd-4845-9a7f-5af78adf2e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:49.906293 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ef99ae-3207-46c0-b1e7-4771a4572a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:49.907342 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Volume b2c77fd4-88b5-43fe-9d17-ef0b80b51639: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2c77fd4-88b5-43fe-9d17-ef0b80b51639', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 21:05:49.909220 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Cloning b2c77fd4-88b5-43fe-9d17-ef0b80b51639 from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 21:05:49.935590 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:05:49.953189 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 5, 49, 944513)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:05:49.954690 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:05:49.955365 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 21:05:49.965174 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.030s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:05:49.970816 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 21:05:49.991233 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 5, 49, 981753)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:05:49.993008 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:05:49.993587 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 21:05:50.015569 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:50.155990 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] creating snapshot='volume-b2c77fd4-88b5-43fe-9d17-ef0b80b51639.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:05:50.686758 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-b2c77fd4-88b5-43fe-9d17-ef0b80b51639.clone_snap' to 'volume-b2c77fd4-88b5-43fe-9d17-ef0b80b51639' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:05:50.992118 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:05:50.995285 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:05:50.995673 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:05:51.120349 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:05:51.121332 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Marking volume b2c77fd4-88b5-43fe-9d17-ef0b80b51639 as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:05:51.135085 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to b2c77fd4-88b5-43fe-9d17-ef0b80b51639. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 21:05:51.136459 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Creating volume glance metadata for volume b2c77fd4-88b5-43fe-9d17-ef0b80b51639 backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 21:05:51.243799 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ef99ae-3207-46c0-b1e7-4771a4572a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c77fd4-88b5-43fe-9d17-ef0b80b51639', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:51.249394 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012d0a14-a83c-44e9-8563-317dbc8c63fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:05:51.274899 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Volume volume-b2c77fd4-88b5-43fe-9d17-ef0b80b51639 (b2c77fd4-88b5-43fe-9d17-ef0b80b51639): created successfully Dec 11 21:05:51.277508 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012d0a14-a83c-44e9-8563-317dbc8c63fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:05:51.281424 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Flow 'volume_create_manager' (8be3626f-455a-430a-92fc-bed18516d396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:05:51.297254 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-eb44cda9-892a-485b-bf01-e2f294bb5a02 tempest-VolumesImageMetadata-1125020998 None] Created volume successfully. Dec 11 21:05:52.324591 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-5094ae4e-c0f8-4d81-8c31-ad7e4d62ce05 tempest-VolumesImageMetadata-1125020998 None] Lock "b'cinder-b2c77fd4-88b5-43fe-9d17-ef0b80b51639-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:05:52.396908 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5094ae4e-c0f8-4d81-8c31-ad7e4d62ce05 tempest-VolumesImageMetadata-1125020998 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:52.545501 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5094ae4e-c0f8-4d81-8c31-ad7e4d62ce05 tempest-VolumesImageMetadata-1125020998 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:05:52.583710 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5094ae4e-c0f8-4d81-8c31-ad7e4d62ce05 tempest-VolumesImageMetadata-1125020998 None] deleting rbd volume volume-b2c77fd4-88b5-43fe-9d17-ef0b80b51639 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:05:53.371888 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5094ae4e-c0f8-4d81-8c31-ad7e4d62ce05 tempest-VolumesImageMetadata-1125020998 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:05:53.433889 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5094ae4e-c0f8-4d81-8c31-ad7e4d62ce05 tempest-VolumesImageMetadata-1125020998 None] deleting parent snapshot volume-b2c77fd4-88b5-43fe-9d17-ef0b80b51639.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:05:54.172704 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-5094ae4e-c0f8-4d81-8c31-ad7e4d62ce05 tempest-VolumesImageMetadata-1125020998 None] Created reservations ['aa8a72d4-a7c9-4cd2-8498-b9df4b342bd9', '9d6dbc48-1937-4c3a-b9f1-15bbbc390b43', '96cc97f1-12e1-4861-bc35-9ae9cb2cf786', '1bfb0dbe-c7f8-4827-a187-9b0ebd0cb665'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:05:54.296542 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5094ae4e-c0f8-4d81-8c31-ad7e4d62ce05 tempest-VolumesImageMetadata-1125020998 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:54.368969 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5094ae4e-c0f8-4d81-8c31-ad7e4d62ce05 tempest-VolumesImageMetadata-1125020998 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:54.441467 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-5094ae4e-c0f8-4d81-8c31-ad7e4d62ce05 tempest-VolumesImageMetadata-1125020998 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:05:54.446994 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-5094ae4e-c0f8-4d81-8c31-ad7e4d62ce05 tempest-VolumesImageMetadata-1125020998 None] Deleted volume successfully. Dec 11 21:05:54.475390 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-5094ae4e-c0f8-4d81-8c31-ad7e4d62ce05 tempest-VolumesImageMetadata-1125020998 None] Lock "b'cinder-b2c77fd4-88b5-43fe-9d17-ef0b80b51639-delete_volume'" released by "delete_volume" :: held 2.150s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:05:55.840989 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:05:55.841548 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:55.918434 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:05:56.012154 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:05:58.833390 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-4221248e-9e0b-4dd8-9a55-3b8c0b58ded8 req-a95ada0e-a3e7-41e8-8458-e74fcf21b08e tempest-TaggedBootDevicesTest_v242-10492700 None] Terminate volume connection completed successfully. Dec 11 21:05:58.834072 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-4221248e-9e0b-4dd8-9a55-3b8c0b58ded8 req-a95ada0e-a3e7-41e8-8458-e74fcf21b08e tempest-TaggedBootDevicesTest_v242-10492700 None] Deleting attachment a7e40a16-ca71-40a7-a784-32357bc57eb8. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:05:59.160864 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-4221248e-9e0b-4dd8-9a55-3b8c0b58ded8 req-230c959c-f0a6-4ad7-a505-864fbf8d8a1a tempest-TaggedBootDevicesTest_v242-10492700 None] Terminate volume connection completed successfully. Dec 11 21:05:59.161279 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-4221248e-9e0b-4dd8-9a55-3b8c0b58ded8 req-230c959c-f0a6-4ad7-a505-864fbf8d8a1a tempest-TaggedBootDevicesTest_v242-10492700 None] Deleting attachment beb5982f-9917-4b4b-8f14-f44efb846ba8. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:05:59.449913 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-4221248e-9e0b-4dd8-9a55-3b8c0b58ded8 req-2cc319f7-f18a-4749-bd44-fa6f0d2d5cb4 tempest-TaggedBootDevicesTest_v242-10492700 None] Terminate volume connection completed successfully. Dec 11 21:05:59.453418 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-4221248e-9e0b-4dd8-9a55-3b8c0b58ded8 req-2cc319f7-f18a-4749-bd44-fa6f0d2d5cb4 tempest-TaggedBootDevicesTest_v242-10492700 None] Deleting attachment 8c272a33-be56-4849-afc7-de6774b87a4d. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:06:00.442166 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:06:00.462569 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:06:00.466805 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:06:00.551559 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Flow 'volume_create_manager' (8edf69e8-883d-4b13-8652-401dd444ad94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:00.561872 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4465f4-a35f-4937-b168-0a3f2246d8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:00.573765 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:06:00.603525 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4465f4-a35f-4937-b168-0a3f2246d8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2079404589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=494c2d6c-632c-423b-9d9f-8326480a0879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609fd6794a78416d9ccc5853e8406aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:06:00Z,use_quota=True,user_id='84f7d3b7243a420b82a3b3026336eb4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:00.610979 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6050f0-d164-4392-91b7-73dce5846350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:00.618382 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6050f0-d164-4392-91b7-73dce5846350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:00.625347 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a6d118-61cb-417c-a9c6-e1445eadded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:00.629976 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a6d118-61cb-417c-a9c6-e1445eadded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '494c2d6c-632c-423b-9d9f-8326480a0879', 'volume_name': 'volume-494c2d6c-632c-423b-9d9f-8326480a0879', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:00.636957 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879022a8-e948-4e1f-bdd8-e235876016fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:00.642082 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879022a8-e948-4e1f-bdd8-e235876016fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:00.653874 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4739e5-e006-4453-9e4d-2a8c34191c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:00.656916 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Volume 494c2d6c-632c-423b-9d9f-8326480a0879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-494c2d6c-632c-423b-9d9f-8326480a0879', 'volume_size': 1} Dec 11 21:06:00.657335 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] creating volume 'volume-494c2d6c-632c-423b-9d9f-8326480a0879' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:06:00.659554 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:00.823789 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:06:00.824180 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:06:00.831811 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4739e5-e006-4453-9e4d-2a8c34191c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-494c2d6c-632c-423b-9d9f-8326480a0879', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:00.834047 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2cb7e7-4db9-4f24-a3bc-9f6e71d427b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:00.858465 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Volume volume-494c2d6c-632c-423b-9d9f-8326480a0879 (494c2d6c-632c-423b-9d9f-8326480a0879): created successfully Dec 11 21:06:00.860951 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2cb7e7-4db9-4f24-a3bc-9f6e71d427b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:00.873028 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Flow 'volume_create_manager' (8edf69e8-883d-4b13-8652-401dd444ad94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:00.891469 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-de8b4cd1-ce7f-4ec7-bacf-d6e4707ee6cf tempest-VolumesDeleteCascade-377355327 None] Created volume successfully. Dec 11 21:06:01.698449 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b1b405ac-ae8c-4713-8884-456a610b5fc0 tempest-VolumesDeleteCascade-377355327 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:02.131697 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b1b405ac-ae8c-4713-8884-456a610b5fc0 tempest-VolumesDeleteCascade-377355327 None] Create snapshot completed successfully Dec 11 21:06:02.953320 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7c0a1c52-2260-4291-ab22-84042388e170 tempest-VolumesDeleteCascade-377355327 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:03.103624 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-3d005233-8be4-48c1-9358-7561f6ea8c3b req-45ea3ca4-129c-4037-8747-80c113d19ca5 tempest-TestVolumeBackupRestore-1162231384 None] Terminate volume connection completed successfully. Dec 11 21:06:03.105735 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-3d005233-8be4-48c1-9358-7561f6ea8c3b req-45ea3ca4-129c-4037-8747-80c113d19ca5 tempest-TestVolumeBackupRestore-1162231384 None] Deleting attachment bec8005f-7c30-44b8-a6a3-ba20cb6bd54a. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:06:04.127886 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7c0a1c52-2260-4291-ab22-84042388e170 tempest-VolumesDeleteCascade-377355327 None] Create snapshot completed successfully Dec 11 21:06:05.113981 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Lock "b'cinder-494c2d6c-632c-423b-9d9f-8326480a0879-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:05.191866 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Performing cascade delete. {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/manager.py:959}} Dec 11 21:06:05.303072 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Lock "b'cinder-48be0c18-9215-4b5f-b975-618ddd72ffb5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.029s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:05.329887 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:05.533255 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-807d63f8-da1c-4f98-8a04-3ca7942465de tempest-TestVolumeBackupRestore-1162231384 None] Lock "b'cinder-1db74c9b-76be-4978-a8ac-3b6cb127fc26-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:05.648053 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-807d63f8-da1c-4f98-8a04-3ca7942465de tempest-TestVolumeBackupRestore-1162231384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:06.088058 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-807d63f8-da1c-4f98-8a04-3ca7942465de tempest-TestVolumeBackupRestore-1162231384 None] Volume volume-1db74c9b-76be-4978-a8ac-3b6cb127fc26 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:06:06.169236 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-807d63f8-da1c-4f98-8a04-3ca7942465de tempest-TestVolumeBackupRestore-1162231384 None] deleting rbd volume volume-1db74c9b-76be-4978-a8ac-3b6cb127fc26 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:06.192118 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d7bdd255-14d8-4b92-a372-ee736a2b4a70 tempest-TestVolumeBackupRestore-1162231384 None] Lock "b'cinder-7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:06.266799 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d7bdd255-14d8-4b92-a372-ee736a2b4a70 tempest-TestVolumeBackupRestore-1162231384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:07.234738 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d7bdd255-14d8-4b92-a372-ee736a2b4a70 tempest-TestVolumeBackupRestore-1162231384 None] deleting rbd volume volume-7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:07.533849 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Created reservations ['8cf054cb-1f5b-425e-addc-d07a3b3d2e9a', 'cd0a1bc9-a3e2-405c-9c1a-017ccd1e0e2d', 'cc694f07-4151-4fe7-b60e-5708e8415095', 'a6e772aa-bbed-4564-8280-727e7eea86f3'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:07.566336 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-807d63f8-da1c-4f98-8a04-3ca7942465de tempest-TestVolumeBackupRestore-1162231384 None] Created reservations ['bcfcd552-5efe-41ed-8d8b-e2372cedf36a', 'caac1061-beee-419b-90d2-2b5d80187e8a', '39b5cb99-3043-4418-bb7d-5719de0ec3a9', '720e4a31-1a2e-4400-ba21-d218c3754aa8'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:07.656779 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Delete snapshot completed successfully. Dec 11 21:06:07.689925 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Lock "b'cinder-48be0c18-9215-4b5f-b975-618ddd72ffb5-delete_snapshot'" released by "delete_snapshot" :: held 2.387s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:07.698455 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-807d63f8-da1c-4f98-8a04-3ca7942465de tempest-TestVolumeBackupRestore-1162231384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:07.751715 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-807d63f8-da1c-4f98-8a04-3ca7942465de tempest-TestVolumeBackupRestore-1162231384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:07.794208 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-807d63f8-da1c-4f98-8a04-3ca7942465de tempest-TestVolumeBackupRestore-1162231384 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:07.800912 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d7bdd255-14d8-4b92-a372-ee736a2b4a70 tempest-TestVolumeBackupRestore-1162231384 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:06:07.852660 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d7bdd255-14d8-4b92-a372-ee736a2b4a70 tempest-TestVolumeBackupRestore-1162231384 None] deleting parent snapshot volume-7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:06:08.228604 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-807d63f8-da1c-4f98-8a04-3ca7942465de tempest-TestVolumeBackupRestore-1162231384 None] Deleted volume successfully. Dec 11 21:06:08.235790 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Lock "b'cinder-bbe4f340-58c6-45c2-a8f8-0a6d89f39df3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.543s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:08.265951 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:08.363108 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-807d63f8-da1c-4f98-8a04-3ca7942465de tempest-TestVolumeBackupRestore-1162231384 None] Lock "b'cinder-1db74c9b-76be-4978-a8ac-3b6cb127fc26-delete_volume'" released by "delete_volume" :: held 2.830s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:08.402743 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-d7bdd255-14d8-4b92-a372-ee736a2b4a70 tempest-TestVolumeBackupRestore-1162231384 None] Created reservations ['993364a1-f613-4b14-be99-12588e7c57a2', 'f1633a8c-c086-4ccf-94de-593e3a141c36', 'dc368988-993b-4ec8-9e9c-31b3812cc650', 'a87232c0-2b2f-4563-a60a-b864acba3dd4'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:08.480442 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d7bdd255-14d8-4b92-a372-ee736a2b4a70 tempest-TestVolumeBackupRestore-1162231384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:08.541733 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d7bdd255-14d8-4b92-a372-ee736a2b4a70 tempest-TestVolumeBackupRestore-1162231384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:08.596539 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-d7bdd255-14d8-4b92-a372-ee736a2b4a70 tempest-TestVolumeBackupRestore-1162231384 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:08.606856 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d7bdd255-14d8-4b92-a372-ee736a2b4a70 tempest-TestVolumeBackupRestore-1162231384 None] Deleted volume successfully. Dec 11 21:06:08.622830 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d7bdd255-14d8-4b92-a372-ee736a2b4a70 tempest-TestVolumeBackupRestore-1162231384 None] Lock "b'cinder-7b7fe2cc-e7c8-4e38-a28e-c31004f8fe0d-delete_volume'" released by "delete_volume" :: held 2.431s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:09.318123 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Created reservations ['baf8b5f8-1949-4f55-98ce-ad81fa25d9d8', 'adc8d578-6c02-4ab6-b1c0-67b7a77f06e5', '56b719e9-a287-4a10-ba02-70989b6c732f', '8d939c42-9c9b-4af8-a531-ac75e4d13c80'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:09.385367 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Delete snapshot completed successfully. Dec 11 21:06:09.398094 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Lock "b'cinder-bbe4f340-58c6-45c2-a8f8-0a6d89f39df3-delete_snapshot'" released by "delete_snapshot" :: held 1.161s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:09.398970 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Snapshots deleted, issuing volume delete {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/manager.py:974}} Dec 11 21:06:09.403261 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:09.527047 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:06:09.527469 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Volume volume-494c2d6c-632c-423b-9d9f-8326480a0879 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:06:09.540345 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] deleting rbd volume volume-494c2d6c-632c-423b-9d9f-8326480a0879 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:10.060224 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Created reservations ['2a99ef7e-17d3-4b7e-90b4-74af84b1ccd6', '046f0a29-1f95-4baf-9ebb-abc294ed5290', '518774ed-6fac-4ce3-a5fd-967b713dd3e6', '9f915bdd-084c-4ab1-aad6-cdcfd1e90c2d'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:10.149402 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:10.203307 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:10.252495 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:10.264688 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Deleted volume successfully. Dec 11 21:06:10.289733 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d9102db8-9498-49d9-8ed7-f56b547752c6 tempest-VolumesDeleteCascade-377355327 None] Lock "b'cinder-494c2d6c-632c-423b-9d9f-8326480a0879-delete_volume'" released by "delete_volume" :: held 5.179s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:11.094261 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-3340cbc0-de4d-4047-b029-8b19cececb6c tempest-TaggedBootDevicesTest_v242-10492700 None] Lock "b'cinder-2598d679-ec5a-4b7f-a18e-b0e2e1dd486c-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:11.185752 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3340cbc0-de4d-4047-b029-8b19cececb6c tempest-TaggedBootDevicesTest_v242-10492700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:11.266266 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3340cbc0-de4d-4047-b029-8b19cececb6c tempest-TaggedBootDevicesTest_v242-10492700 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:06:11.267884 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3340cbc0-de4d-4047-b029-8b19cececb6c tempest-TaggedBootDevicesTest_v242-10492700 None] Volume volume-2598d679-ec5a-4b7f-a18e-b0e2e1dd486c is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:06:11.284208 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3340cbc0-de4d-4047-b029-8b19cececb6c tempest-TaggedBootDevicesTest_v242-10492700 None] deleting rbd volume volume-2598d679-ec5a-4b7f-a18e-b0e2e1dd486c {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:11.851919 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-3340cbc0-de4d-4047-b029-8b19cececb6c tempest-TaggedBootDevicesTest_v242-10492700 None] Created reservations ['629931a7-b2ff-4380-b82f-79df36e17223', '121ddc7f-3aeb-4ed2-85ad-b2f75030a0f6', '5c89b0a9-dfbb-49ab-bde1-75715bbf3713', '5b9ccf61-3bd0-4a7b-b8e2-ddfe8e5af300'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:11.955108 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3340cbc0-de4d-4047-b029-8b19cececb6c tempest-TaggedBootDevicesTest_v242-10492700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:12.023400 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3340cbc0-de4d-4047-b029-8b19cececb6c tempest-TaggedBootDevicesTest_v242-10492700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:12.090814 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-3340cbc0-de4d-4047-b029-8b19cececb6c tempest-TaggedBootDevicesTest_v242-10492700 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:12.094889 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-3340cbc0-de4d-4047-b029-8b19cececb6c tempest-TaggedBootDevicesTest_v242-10492700 None] Deleted volume successfully. Dec 11 21:06:12.118779 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-3340cbc0-de4d-4047-b029-8b19cececb6c tempest-TaggedBootDevicesTest_v242-10492700 None] Lock "b'cinder-2598d679-ec5a-4b7f-a18e-b0e2e1dd486c-delete_volume'" released by "delete_volume" :: held 1.024s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:12.317602 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-b7e69c4d-2d6d-42a2-b9fb-ccceae0570ae tempest-TaggedBootDevicesTest_v242-10492700 None] Lock "b'cinder-1cc24081-5bd3-4779-a26a-13ece3c04557-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:12.404237 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b7e69c4d-2d6d-42a2-b9fb-ccceae0570ae tempest-TaggedBootDevicesTest_v242-10492700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:12.503400 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b7e69c4d-2d6d-42a2-b9fb-ccceae0570ae tempest-TaggedBootDevicesTest_v242-10492700 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:06:12.503881 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b7e69c4d-2d6d-42a2-b9fb-ccceae0570ae tempest-TaggedBootDevicesTest_v242-10492700 None] Volume volume-1cc24081-5bd3-4779-a26a-13ece3c04557 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:06:12.511035 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b7e69c4d-2d6d-42a2-b9fb-ccceae0570ae tempest-TaggedBootDevicesTest_v242-10492700 None] deleting rbd volume volume-1cc24081-5bd3-4779-a26a-13ece3c04557 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:13.072337 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-b7e69c4d-2d6d-42a2-b9fb-ccceae0570ae tempest-TaggedBootDevicesTest_v242-10492700 None] Created reservations ['0233641b-5e61-4f80-8160-730d1d692c96', 'f70aa0a9-492f-48cd-98d7-7f59fe4bc4d9', '66af509c-34eb-4a62-a11e-72eb32222497', '954a9fe3-ef39-49bd-aa4d-f42bc37ec8e5'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:13.165155 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b7e69c4d-2d6d-42a2-b9fb-ccceae0570ae tempest-TaggedBootDevicesTest_v242-10492700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:13.275220 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b7e69c4d-2d6d-42a2-b9fb-ccceae0570ae tempest-TaggedBootDevicesTest_v242-10492700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:13.355317 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-b7e69c4d-2d6d-42a2-b9fb-ccceae0570ae tempest-TaggedBootDevicesTest_v242-10492700 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:13.359684 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b7e69c4d-2d6d-42a2-b9fb-ccceae0570ae tempest-TaggedBootDevicesTest_v242-10492700 None] Deleted volume successfully. Dec 11 21:06:13.386518 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-b7e69c4d-2d6d-42a2-b9fb-ccceae0570ae tempest-TaggedBootDevicesTest_v242-10492700 None] Lock "b'cinder-1cc24081-5bd3-4779-a26a-13ece3c04557-delete_volume'" released by "delete_volume" :: held 1.069s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:13.578394 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7bad1d49-238d-4fe8-821e-807e8e52f6d2 tempest-TaggedBootDevicesTest_v242-10492700 None] Lock "b'cinder-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:13.660028 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bad1d49-238d-4fe8-821e-807e8e52f6d2 tempest-TaggedBootDevicesTest_v242-10492700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:13.795939 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bad1d49-238d-4fe8-821e-807e8e52f6d2 tempest-TaggedBootDevicesTest_v242-10492700 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:06:13.814161 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bad1d49-238d-4fe8-821e-807e8e52f6d2 tempest-TaggedBootDevicesTest_v242-10492700 None] deleting rbd volume volume-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:14.341283 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bad1d49-238d-4fe8-821e-807e8e52f6d2 tempest-TaggedBootDevicesTest_v242-10492700 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:06:14.392096 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bad1d49-238d-4fe8-821e-807e8e52f6d2 tempest-TaggedBootDevicesTest_v242-10492700 None] deleting parent snapshot volume-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:06:15.219470 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-7bad1d49-238d-4fe8-821e-807e8e52f6d2 tempest-TaggedBootDevicesTest_v242-10492700 None] Created reservations ['8473f72b-b056-4ada-aa4b-2e6116b46968', '586279e3-e03c-44ea-ae75-7cf6037d48be', '568a2561-f91f-403d-a528-b2937c1088ac', '9fd322cf-633e-4b36-9d4a-97a0fd356b43'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:15.307318 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bad1d49-238d-4fe8-821e-807e8e52f6d2 tempest-TaggedBootDevicesTest_v242-10492700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:15.370949 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bad1d49-238d-4fe8-821e-807e8e52f6d2 tempest-TaggedBootDevicesTest_v242-10492700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:15.467806 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bad1d49-238d-4fe8-821e-807e8e52f6d2 tempest-TaggedBootDevicesTest_v242-10492700 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:15.473803 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7bad1d49-238d-4fe8-821e-807e8e52f6d2 tempest-TaggedBootDevicesTest_v242-10492700 None] Deleted volume successfully. Dec 11 21:06:15.498059 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7bad1d49-238d-4fe8-821e-807e8e52f6d2 tempest-TaggedBootDevicesTest_v242-10492700 None] Lock "b'cinder-bacff558-89b8-4eb4-a4cc-bdf5b3ea8f07-delete_volume'" released by "delete_volume" :: held 1.920s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:15.708057 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:06:15.717048 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:06:15.717506 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:06:15.760876 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Flow 'volume_create_manager' (1a0d1049-65a5-43fb-88ab-e82cdc10b5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:15.765319 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccccb0de-1ccc-474f-bcb9-3cda1250a253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:15.774430 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:06:15.792655 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccccb0de-1ccc-474f-bcb9-3cda1250a253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-759469737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=78342019-478e-43a5-8d0b-38bf722c00ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed1ad09c8074b05b6378b1e89f65669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:06:16Z,use_quota=True,user_id='7cd2f7f47e104cdda7c9074fde4fe414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:15.796244 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea24b6ad-2e64-4423-8e4d-1fc908cb88e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:15.799902 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea24b6ad-2e64-4423-8e4d-1fc908cb88e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:15.806167 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b174eac-2658-49e3-930f-d7e145dbd41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:15.809380 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b174eac-2658-49e3-930f-d7e145dbd41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78342019-478e-43a5-8d0b-38bf722c00ec', 'volume_name': 'volume-78342019-478e-43a5-8d0b-38bf722c00ec', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:15.813764 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae37b18-17ab-4a45-87a1-50d607b95b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:15.816528 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae37b18-17ab-4a45-87a1-50d607b95b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:15.820490 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308569e3-9062-4f47-90cc-a02c90b203c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:15.822743 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Volume 78342019-478e-43a5-8d0b-38bf722c00ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78342019-478e-43a5-8d0b-38bf722c00ec', 'volume_size': 1} Dec 11 21:06:15.823706 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] creating volume 'volume-78342019-478e-43a5-8d0b-38bf722c00ec' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:06:15.824907 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:15.961483 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:06:15.962138 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:06:15.965357 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308569e3-9062-4f47-90cc-a02c90b203c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78342019-478e-43a5-8d0b-38bf722c00ec', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:15.968884 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67caf9c-d708-436c-93f3-490608fa4edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:15.989235 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Volume volume-78342019-478e-43a5-8d0b-38bf722c00ec (78342019-478e-43a5-8d0b-38bf722c00ec): created successfully Dec 11 21:06:15.992330 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67caf9c-d708-436c-93f3-490608fa4edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:15.999932 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Flow 'volume_create_manager' (1a0d1049-65a5-43fb-88ab-e82cdc10b5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:16.023595 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-691e44c3-60be-44e0-abea-b781d0b8236e tempest-VolumesBackupsV39Test-978310112 None] Created volume successfully. Dec 11 21:06:16.904839 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-c2327310-c652-4ed1-a0ad-776a7d38ce4a tempest-VolumesBackupsV39Test-978310112 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:06:17.961675 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-c2327310-c652-4ed1-a0ad-776a7d38ce4a tempest-VolumesBackupsV39Test-978310112 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.057s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:06:17.963832 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c2327310-c652-4ed1-a0ad-776a7d38ce4a tempest-VolumesBackupsV39Test-978310112 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-78342019-478e-43a5-8d0b-38bf722c00ec', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '78342019-478e-43a5-8d0b-38bf722c00ec', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:06:17.984790 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c2327310-c652-4ed1-a0ad-776a7d38ce4a tempest-VolumesBackupsV39Test-978310112 None] Initialize volume connection completed successfully. Dec 11 21:06:20.530710 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c2327310-c652-4ed1-a0ad-776a7d38ce4a tempest-VolumesBackupsV39Test-978310112 None] Terminate volume connection completed successfully. Dec 11 21:06:20.552927 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c2327310-c652-4ed1-a0ad-776a7d38ce4a tempest-VolumesBackupsV39Test-978310112 None] Remove volume export completed successfully. Dec 11 21:06:23.365434 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-bd42295e-6542-4664-bbd2-983a87f2d9d9 tempest-VolumesBackupsV39Test-978310112 None] Lock "b'cinder-78342019-478e-43a5-8d0b-38bf722c00ec-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:23.483156 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bd42295e-6542-4664-bbd2-983a87f2d9d9 tempest-VolumesBackupsV39Test-978310112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:24.105474 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bd42295e-6542-4664-bbd2-983a87f2d9d9 tempest-VolumesBackupsV39Test-978310112 None] Volume volume-78342019-478e-43a5-8d0b-38bf722c00ec is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:06:24.145377 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bd42295e-6542-4664-bbd2-983a87f2d9d9 tempest-VolumesBackupsV39Test-978310112 None] deleting rbd volume volume-78342019-478e-43a5-8d0b-38bf722c00ec {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:24.553899 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-bd42295e-6542-4664-bbd2-983a87f2d9d9 tempest-VolumesBackupsV39Test-978310112 None] Created reservations ['f560962c-4fde-4e31-9e9a-83831b66af21', 'fbd8c1e9-1561-4c3c-b216-749d3946046d', '3c094186-1224-4e85-ba45-fd78bb062a4e', '4f17ba8f-98ac-4667-8649-588c538c48ed'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:24.638980 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bd42295e-6542-4664-bbd2-983a87f2d9d9 tempest-VolumesBackupsV39Test-978310112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:24.687087 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bd42295e-6542-4664-bbd2-983a87f2d9d9 tempest-VolumesBackupsV39Test-978310112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:24.756351 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-bd42295e-6542-4664-bbd2-983a87f2d9d9 tempest-VolumesBackupsV39Test-978310112 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:24.763313 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-bd42295e-6542-4664-bbd2-983a87f2d9d9 tempest-VolumesBackupsV39Test-978310112 None] Deleted volume successfully. Dec 11 21:06:24.782356 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-bd42295e-6542-4664-bbd2-983a87f2d9d9 tempest-VolumesBackupsV39Test-978310112 None] Lock "b'cinder-78342019-478e-43a5-8d0b-38bf722c00ec-delete_volume'" released by "delete_volume" :: held 1.417s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:26.666807 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-9d279cf5-a57a-4d65-93dd-a26bf763a0f2 tempest-DeleteServersTestJSON-1962391540 None] Lock "b'cinder-c7910b47-de22-4de6-898a-baf89e2af426-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:26.710517 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9d279cf5-a57a-4d65-93dd-a26bf763a0f2 tempest-DeleteServersTestJSON-1962391540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:26.788412 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9d279cf5-a57a-4d65-93dd-a26bf763a0f2 tempest-DeleteServersTestJSON-1962391540 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:06:26.789093 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9d279cf5-a57a-4d65-93dd-a26bf763a0f2 tempest-DeleteServersTestJSON-1962391540 None] Volume volume-c7910b47-de22-4de6-898a-baf89e2af426 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:06:26.800866 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9d279cf5-a57a-4d65-93dd-a26bf763a0f2 tempest-DeleteServersTestJSON-1962391540 None] deleting rbd volume volume-c7910b47-de22-4de6-898a-baf89e2af426 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:27.359747 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-9d279cf5-a57a-4d65-93dd-a26bf763a0f2 tempest-DeleteServersTestJSON-1962391540 None] Created reservations ['85691ace-dc31-4f99-97b7-45b8db520adf', '7c03e395-43ad-4acd-a90e-28f28cb4be38', '349bf7ef-40ed-4f56-8478-3bd41a11b945', '1afdc284-4db0-47f2-895d-241ae1adeaef'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:27.445444 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9d279cf5-a57a-4d65-93dd-a26bf763a0f2 tempest-DeleteServersTestJSON-1962391540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:27.528258 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9d279cf5-a57a-4d65-93dd-a26bf763a0f2 tempest-DeleteServersTestJSON-1962391540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:27.576105 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-9d279cf5-a57a-4d65-93dd-a26bf763a0f2 tempest-DeleteServersTestJSON-1962391540 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:27.580505 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9d279cf5-a57a-4d65-93dd-a26bf763a0f2 tempest-DeleteServersTestJSON-1962391540 None] Deleted volume successfully. Dec 11 21:06:27.611702 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-9d279cf5-a57a-4d65-93dd-a26bf763a0f2 tempest-DeleteServersTestJSON-1962391540 None] Lock "b'cinder-c7910b47-de22-4de6-898a-baf89e2af426-delete_volume'" released by "delete_volume" :: held 0.945s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:29.475142 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:06:29.488172 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:06:29.488689 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:06:29.507697 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Flow 'volume_create_manager' (d2993f4c-b15e-4959-885e-22416ce3acf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:29.512071 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f61c5e-c98c-410a-b399-fcb8fb086cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:29.520768 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:06:29.538426 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f61c5e-c98c-410a-b399-fcb8fb086cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-865839513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5cd89177-c7b1-467e-b0fe-cd8b8c3589fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d890a347aee9452a8109f9918b98f137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:06:29Z,use_quota=True,user_id='51b30ab93ef544afa3d2d3c3e876396a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:29.542761 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa2b75f-1f74-4942-a3d8-7829cef198ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:29.545315 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa2b75f-1f74-4942-a3d8-7829cef198ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:29.548298 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c378df-3b82-4693-910b-df0b929e906e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:29.699732 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c378df-3b82-4693-910b-df0b929e906e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5cd89177-c7b1-467e-b0fe-cd8b8c3589fd', 'volume_name': 'volume-5cd89177-c7b1-467e-b0fe-cd8b8c3589fd', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:29.704401 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a66424-b65d-4821-a155-280bc20d9753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:29.708113 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a66424-b65d-4821-a155-280bc20d9753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:29.712347 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a798f27f-10e0-4990-b8f2-0256555c11e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:29.714145 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Volume 5cd89177-c7b1-467e-b0fe-cd8b8c3589fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5cd89177-c7b1-467e-b0fe-cd8b8c3589fd', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 21:06:29.715173 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Cloning 5cd89177-c7b1-467e-b0fe-cd8b8c3589fd from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 21:06:29.730023 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:29.745963 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 6, 29, 738168)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:06:29.746411 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:06:29.749058 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 21:06:29.760665 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.031s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:29.761678 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 21:06:29.772741 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 6, 29, 765925)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:06:29.774875 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:06:29.775770 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 21:06:29.795036 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:29.921579 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] creating snapshot='volume-5cd89177-c7b1-467e-b0fe-cd8b8c3589fd.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:06:30.633889 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-5cd89177-c7b1-467e-b0fe-cd8b8c3589fd.clone_snap' to 'volume-5cd89177-c7b1-467e-b0fe-cd8b8c3589fd' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:06:30.822884 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:06:30.824188 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:06:30.824760 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:06:30.852253 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:06:30.853503 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Marking volume 5cd89177-c7b1-467e-b0fe-cd8b8c3589fd as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:06:30.863959 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to 5cd89177-c7b1-467e-b0fe-cd8b8c3589fd. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 21:06:30.864691 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Creating volume glance metadata for volume 5cd89177-c7b1-467e-b0fe-cd8b8c3589fd backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 21:06:30.966583 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a798f27f-10e0-4990-b8f2-0256555c11e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd89177-c7b1-467e-b0fe-cd8b8c3589fd', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:30.969472 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29adfd18-43fd-468d-bf50-f6939c19b588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:30.982715 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Volume volume-5cd89177-c7b1-467e-b0fe-cd8b8c3589fd (5cd89177-c7b1-467e-b0fe-cd8b8c3589fd): created successfully Dec 11 21:06:30.986055 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29adfd18-43fd-468d-bf50-f6939c19b588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:30.990084 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Flow 'volume_create_manager' (d2993f4c-b15e-4959-885e-22416ce3acf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:31.017361 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4292e7e9-249b-4f63-af6f-14b17c451abb tempest-VolumesCloneTest-162905673 None] Created volume successfully. Dec 11 21:06:32.118230 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:06:32.124299 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:06:32.125286 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:06:32.153430 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Flow 'volume_create_manager' (65c88732-9c43-4c39-bc79-fe313b430872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:32.157679 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4cb00a-bf94-4e6f-9348-3319980ed228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:32.165247 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:06:32.182321 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4cb00a-bf94-4e6f-9348-3319980ed228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2060213200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ead0b6e9-032d-4c39-92d2-ce9d5b911a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d890a347aee9452a8109f9918b98f137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5cd89177-c7b1-467e-b0fe-cd8b8c3589fd,status='creating',terminated_at=None,updated_at=2021-12-11T21:06:32Z,use_quota=True,user_id='51b30ab93ef544afa3d2d3c3e876396a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:32.186043 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fd324a-6ef2-4aaf-9cb3-5adb1fb3dd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:32.188704 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fd324a-6ef2-4aaf-9cb3-5adb1fb3dd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:32.194077 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d6a57b-196a-4f24-b476-b5d818e54527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:32.214215 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d6a57b-196a-4f24-b476-b5d818e54527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ead0b6e9-032d-4c39-92d2-ce9d5b911a9f', 'volume_name': 'volume-ead0b6e9-032d-4c39-92d2-ce9d5b911a9f', 'volume_size': 1, 'source_volid': '5cd89177-c7b1-467e-b0fe-cd8b8c3589fd', 'source_volstatus': 'available'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:32.218896 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a808d48-df69-42f9-bda6-824fe41c0034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:32.222447 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a808d48-df69-42f9-bda6-824fe41c0034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:32.226759 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09289cb8-b6fa-456e-833d-ee9440bbaf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:32.227930 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Volume ead0b6e9-032d-4c39-92d2-ce9d5b911a9f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ead0b6e9-032d-4c39-92d2-ce9d5b911a9f', 'volume_size': 1, 'source_volid': '5cd89177-c7b1-467e-b0fe-cd8b8c3589fd', 'source_volstatus': 'available'} Dec 11 21:06:32.241705 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:32.364174 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] creating snapshot='volume-ead0b6e9-032d-4c39-92d2-ce9d5b911a9f.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:06:33.108536 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] cloning 'volume-5cd89177-c7b1-467e-b0fe-cd8b8c3589fd@volume-ead0b6e9-032d-4c39-92d2-ce9d5b911a9f.clone_snap' to 'volume-ead0b6e9-032d-4c39-92d2-ce9d5b911a9f' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:06:33.436694 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:06:33.437931 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:06:33.438308 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:06:33.493708 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:06:33.494351 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Marking volume ead0b6e9-032d-4c39-92d2-ce9d5b911a9f as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:06:33.510529 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Copying metadata from source volume 5cd89177-c7b1-467e-b0fe-cd8b8c3589fd to ead0b6e9-032d-4c39-92d2-ce9d5b911a9f. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:432}} Dec 11 21:06:33.566567 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09289cb8-b6fa-456e-833d-ee9440bbaf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ead0b6e9-032d-4c39-92d2-ce9d5b911a9f', 'volume_size': 1, 'source_volid': '5cd89177-c7b1-467e-b0fe-cd8b8c3589fd', 'source_volstatus': 'available'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:33.570292 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa341d1e-9f71-4383-95eb-ddd06532e668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:33.598775 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Volume volume-ead0b6e9-032d-4c39-92d2-ce9d5b911a9f (ead0b6e9-032d-4c39-92d2-ce9d5b911a9f): created successfully Dec 11 21:06:33.601119 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa341d1e-9f71-4383-95eb-ddd06532e668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:33.605776 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Flow 'volume_create_manager' (65c88732-9c43-4c39-bc79-fe313b430872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:33.626999 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-312a67e3-5833-407e-96ba-9487cee94dab tempest-VolumesCloneTest-162905673 None] Created volume successfully. Dec 11 21:06:34.689363 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:06:34.703857 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:06:34.705128 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:06:34.720553 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Flow 'volume_create_manager' (9c75810f-442f-4b17-8c40-39156210a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:34.725095 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1cc3f89-9684-4e11-af72-8debfb60f0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:34.734626 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:06:34.752362 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1cc3f89-9684-4e11-af72-8debfb60f0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1917405232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e5394b85-abbe-4699-a168-0b4af15fd481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d890a347aee9452a8109f9918b98f137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:06:35Z,use_quota=True,user_id='51b30ab93ef544afa3d2d3c3e876396a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:34.755188 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22acfab9-b814-41a9-97e5-c69e1452a99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:34.764135 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22acfab9-b814-41a9-97e5-c69e1452a99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:34.767136 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6006641-fba0-4905-99db-82556dda0fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:34.769926 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6006641-fba0-4905-99db-82556dda0fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5394b85-abbe-4699-a168-0b4af15fd481', 'volume_name': 'volume-e5394b85-abbe-4699-a168-0b4af15fd481', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:34.774415 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058e572a-a3b1-4d0d-82a7-e6889fc7abe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:34.777141 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058e572a-a3b1-4d0d-82a7-e6889fc7abe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:34.779657 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3117bfe3-87a4-474c-b705-3028c6d0b7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:34.780475 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Volume e5394b85-abbe-4699-a168-0b4af15fd481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5394b85-abbe-4699-a168-0b4af15fd481', 'volume_size': 1} Dec 11 21:06:34.780875 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] creating volume 'volume-e5394b85-abbe-4699-a168-0b4af15fd481' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:06:34.782019 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:34.887469 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:06:34.888315 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:06:34.891074 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3117bfe3-87a4-474c-b705-3028c6d0b7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5394b85-abbe-4699-a168-0b4af15fd481', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:34.894258 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e140862-9f93-4287-87fc-72371713fced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:34.908671 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Volume volume-e5394b85-abbe-4699-a168-0b4af15fd481 (e5394b85-abbe-4699-a168-0b4af15fd481): created successfully Dec 11 21:06:34.910692 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e140862-9f93-4287-87fc-72371713fced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:34.914095 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Flow 'volume_create_manager' (9c75810f-442f-4b17-8c40-39156210a149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:34.930407 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9201791c-a45a-4066-90a4-187b58e39fd3 tempest-VolumesCloneTest-162905673 None] Created volume successfully. Dec 11 21:06:36.299575 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:06:36.311131 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:06:36.312341 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:06:36.339602 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Flow 'volume_create_manager' (88d94815-d0ee-418c-be5a-1a907e26d338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:36.343447 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0f2a38-6c38-4312-a729-6ead70182edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:36.350465 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:06:36.368592 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0f2a38-6c38-4312-a729-6ead70182edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2101098492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=86d22aa0-2169-459d-8ed7-d13b80b9d5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d890a347aee9452a8109f9918b98f137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:06:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e5394b85-abbe-4699-a168-0b4af15fd481,status='creating',terminated_at=None,updated_at=2021-12-11T21:06:36Z,use_quota=True,user_id='51b30ab93ef544afa3d2d3c3e876396a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:36.371642 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df63bbb8-fd68-4454-a35e-7fd0144d471a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:36.375429 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df63bbb8-fd68-4454-a35e-7fd0144d471a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:36.378453 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b00dea-9219-4c22-aa42-e6ba3831b829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:36.403533 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b00dea-9219-4c22-aa42-e6ba3831b829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '86d22aa0-2169-459d-8ed7-d13b80b9d5be', 'volume_name': 'volume-86d22aa0-2169-459d-8ed7-d13b80b9d5be', 'volume_size': 2, 'source_volid': 'e5394b85-abbe-4699-a168-0b4af15fd481', 'source_volstatus': 'available'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:36.412716 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23edd4c5-25a0-453c-b41c-1072e3c229d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:36.416805 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23edd4c5-25a0-453c-b41c-1072e3c229d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:36.419615 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26d7cac-31d2-427c-8734-988d15e8d784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:36.420584 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Volume 86d22aa0-2169-459d-8ed7-d13b80b9d5be: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-86d22aa0-2169-459d-8ed7-d13b80b9d5be', 'volume_size': 2, 'source_volid': 'e5394b85-abbe-4699-a168-0b4af15fd481', 'source_volstatus': 'available'} Dec 11 21:06:36.436066 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:36.487912 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] creating snapshot='volume-86d22aa0-2169-459d-8ed7-d13b80b9d5be.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:06:37.536460 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] cloning 'volume-e5394b85-abbe-4699-a168-0b4af15fd481@volume-86d22aa0-2169-459d-8ed7-d13b80b9d5be.clone_snap' to 'volume-86d22aa0-2169-459d-8ed7-d13b80b9d5be' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:06:37.688884 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Volume volume-e5394b85-abbe-4699-a168-0b4af15fd481 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:06:37.690554 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:06:37.691113 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:06:37.726730 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] resize volume 'volume-86d22aa0-2169-459d-8ed7-d13b80b9d5be' from 1 to 2 {{(pid=134173) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:694}} Dec 11 21:06:37.727521 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:37.965615 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:06:37.968191 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26d7cac-31d2-427c-8734-988d15e8d784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86d22aa0-2169-459d-8ed7-d13b80b9d5be', 'volume_size': 2, 'source_volid': 'e5394b85-abbe-4699-a168-0b4af15fd481', 'source_volstatus': 'available'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:37.971184 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966983c1-ec82-42a6-a7c9-1f8d553073e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:37.982609 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Volume volume-86d22aa0-2169-459d-8ed7-d13b80b9d5be (86d22aa0-2169-459d-8ed7-d13b80b9d5be): created successfully Dec 11 21:06:37.985259 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966983c1-ec82-42a6-a7c9-1f8d553073e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:37.989179 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Flow 'volume_create_manager' (88d94815-d0ee-418c-be5a-1a907e26d338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:38.011170 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-e2e91f14-4b77-412b-855a-d405dc9e0622 tempest-VolumesCloneTest-162905673 None] Created volume successfully. Dec 11 21:06:38.476580 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] Lock "b'cinder-86d22aa0-2169-459d-8ed7-d13b80b9d5be-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:38.539347 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:38.625424 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:06:38.632726 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] deleting rbd volume volume-86d22aa0-2169-459d-8ed7-d13b80b9d5be {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:39.052127 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:06:39.091989 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] Volume volume-e5394b85-abbe-4699-a168-0b4af15fd481 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:06:39.092742 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] deleting parent snapshot volume-86d22aa0-2169-459d-8ed7-d13b80b9d5be.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:06:39.684420 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] Created reservations ['d20d4c51-b3f7-4583-a750-32a091a83509', '8a530d4a-82d0-4fa1-afea-10aa556b4126', 'dc3ca02a-12e9-43bb-842c-32a64b0566f3', '1b4df39a-7c35-45ae-8e25-50716125e548'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:39.776017 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:39.840033 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:39.939182 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:39.945413 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] Deleted volume successfully. Dec 11 21:06:39.967236 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-e3dc9a73-f744-4dc5-8248-3477d654d84a tempest-VolumesCloneTest-162905673 None] Lock "b'cinder-86d22aa0-2169-459d-8ed7-d13b80b9d5be-delete_volume'" released by "delete_volume" :: held 1.489s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:40.719544 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-28a49fd2-834c-4697-b2ae-bbd672c95ff7 tempest-VolumesCloneTest-162905673 None] Lock "b'cinder-e5394b85-abbe-4699-a168-0b4af15fd481-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:40.805247 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-28a49fd2-834c-4697-b2ae-bbd672c95ff7 tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:40.877183 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-28a49fd2-834c-4697-b2ae-bbd672c95ff7 tempest-VolumesCloneTest-162905673 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:06:40.878048 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-28a49fd2-834c-4697-b2ae-bbd672c95ff7 tempest-VolumesCloneTest-162905673 None] Volume volume-e5394b85-abbe-4699-a168-0b4af15fd481 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:06:40.886513 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-28a49fd2-834c-4697-b2ae-bbd672c95ff7 tempest-VolumesCloneTest-162905673 None] deleting rbd volume volume-e5394b85-abbe-4699-a168-0b4af15fd481 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:41.351030 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-28a49fd2-834c-4697-b2ae-bbd672c95ff7 tempest-VolumesCloneTest-162905673 None] Created reservations ['83987d94-c18e-46cb-89aa-dfdb76d50735', 'd150ce6d-c79e-4ae6-83e2-1802f0e55c51', '2d2df312-d413-419c-ad25-cee80ef2db45', '3d60b8c9-4931-4df0-81e3-2377b71ea544'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:41.517355 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-28a49fd2-834c-4697-b2ae-bbd672c95ff7 tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:41.605530 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-28a49fd2-834c-4697-b2ae-bbd672c95ff7 tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:41.645924 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-28a49fd2-834c-4697-b2ae-bbd672c95ff7 tempest-VolumesCloneTest-162905673 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:41.650079 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-28a49fd2-834c-4697-b2ae-bbd672c95ff7 tempest-VolumesCloneTest-162905673 None] Deleted volume successfully. Dec 11 21:06:41.669842 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-28a49fd2-834c-4697-b2ae-bbd672c95ff7 tempest-VolumesCloneTest-162905673 None] Lock "b'cinder-e5394b85-abbe-4699-a168-0b4af15fd481-delete_volume'" released by "delete_volume" :: held 0.950s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:41.905381 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-a21c3641-0cca-411f-b742-3b767305c41f tempest-VolumesCloneTest-162905673 None] Lock "b'cinder-ead0b6e9-032d-4c39-92d2-ce9d5b911a9f-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:41.948901 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a21c3641-0cca-411f-b742-3b767305c41f tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:42.088447 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a21c3641-0cca-411f-b742-3b767305c41f tempest-VolumesCloneTest-162905673 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:06:42.100062 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a21c3641-0cca-411f-b742-3b767305c41f tempest-VolumesCloneTest-162905673 None] deleting rbd volume volume-ead0b6e9-032d-4c39-92d2-ce9d5b911a9f {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:42.377259 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a21c3641-0cca-411f-b742-3b767305c41f tempest-VolumesCloneTest-162905673 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:06:42.427197 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a21c3641-0cca-411f-b742-3b767305c41f tempest-VolumesCloneTest-162905673 None] deleting parent snapshot volume-ead0b6e9-032d-4c39-92d2-ce9d5b911a9f.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:06:43.212524 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-a21c3641-0cca-411f-b742-3b767305c41f tempest-VolumesCloneTest-162905673 None] Created reservations ['b239462d-3912-4289-9173-00b69f54b72c', '717b73eb-3f5c-4f6f-a4d6-38267618fb74', '0b7db620-3135-4253-89fe-b6e1c941f7da', 'c18a9f66-bd74-447b-8f3f-cf1ede1bd238'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:43.360741 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a21c3641-0cca-411f-b742-3b767305c41f tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:43.442235 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a21c3641-0cca-411f-b742-3b767305c41f tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:43.505100 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-a21c3641-0cca-411f-b742-3b767305c41f tempest-VolumesCloneTest-162905673 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:43.511768 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-a21c3641-0cca-411f-b742-3b767305c41f tempest-VolumesCloneTest-162905673 None] Deleted volume successfully. Dec 11 21:06:43.527847 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-a21c3641-0cca-411f-b742-3b767305c41f tempest-VolumesCloneTest-162905673 None] Lock "b'cinder-ead0b6e9-032d-4c39-92d2-ce9d5b911a9f-delete_volume'" released by "delete_volume" :: held 1.622s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:44.219605 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-bf4e22b3-8a31-4b91-a3bb-796d494bcf2e tempest-VolumesCloneTest-162905673 None] Lock "b'cinder-5cd89177-c7b1-467e-b0fe-cd8b8c3589fd-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:44.296767 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf4e22b3-8a31-4b91-a3bb-796d494bcf2e tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:44.417529 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf4e22b3-8a31-4b91-a3bb-796d494bcf2e tempest-VolumesCloneTest-162905673 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:06:44.431361 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf4e22b3-8a31-4b91-a3bb-796d494bcf2e tempest-VolumesCloneTest-162905673 None] deleting rbd volume volume-5cd89177-c7b1-467e-b0fe-cd8b8c3589fd {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:44.750228 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf4e22b3-8a31-4b91-a3bb-796d494bcf2e tempest-VolumesCloneTest-162905673 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:06:44.793787 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf4e22b3-8a31-4b91-a3bb-796d494bcf2e tempest-VolumesCloneTest-162905673 None] deleting parent snapshot volume-5cd89177-c7b1-467e-b0fe-cd8b8c3589fd.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:06:45.836980 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-bf4e22b3-8a31-4b91-a3bb-796d494bcf2e tempest-VolumesCloneTest-162905673 None] Created reservations ['2a49828d-bfd8-40d9-ad80-0a05eb5c3807', '6b9371a2-bb94-4e5b-bd0b-6ef61e8b7b67', '2dc89c26-942f-4a14-891d-5e311f364936', '980f37ab-a8fe-44f4-a5b6-78eed2d2e760'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:45.909363 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf4e22b3-8a31-4b91-a3bb-796d494bcf2e tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:45.976905 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf4e22b3-8a31-4b91-a3bb-796d494bcf2e tempest-VolumesCloneTest-162905673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:46.038834 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-bf4e22b3-8a31-4b91-a3bb-796d494bcf2e tempest-VolumesCloneTest-162905673 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:46.044754 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-bf4e22b3-8a31-4b91-a3bb-796d494bcf2e tempest-VolumesCloneTest-162905673 None] Deleted volume successfully. Dec 11 21:06:46.060701 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-bf4e22b3-8a31-4b91-a3bb-796d494bcf2e tempest-VolumesCloneTest-162905673 None] Lock "b'cinder-5cd89177-c7b1-467e-b0fe-cd8b8c3589fd-delete_volume'" released by "delete_volume" :: held 1.841s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:48.693899 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:06:48.702059 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:06:48.702570 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:06:48.728322 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Flow 'volume_create_manager' (a428ee8f-3384-4a6b-a0db-339b15b8b9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:48.731479 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42be52a-290d-4e7e-a2a7-fb341b385164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:48.751812 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:06:48.777633 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42be52a-290d-4e7e-a2a7-fb341b385164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1008337414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=86929df5-11f4-47e6-b556-4f68fb98918f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03574fdb5c7e498786f72279118c2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:06:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:06:49Z,use_quota=True,user_id='276e72b8ef104a09b3a145b2c7ed15cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:48.780456 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa22ec42-d1bb-42a0-9e56-40619213c5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:48.782861 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa22ec42-d1bb-42a0-9e56-40619213c5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:48.787462 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6caec3c-f7ab-4a08-b12e-ee7f03a35726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:48.790275 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6caec3c-f7ab-4a08-b12e-ee7f03a35726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86929df5-11f4-47e6-b556-4f68fb98918f', 'volume_name': 'volume-86929df5-11f4-47e6-b556-4f68fb98918f', 'volume_size': 2}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:48.793226 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9eca9da-1e01-4afd-b23c-6d1236cc864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:48.795792 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9eca9da-1e01-4afd-b23c-6d1236cc864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:48.798362 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fde4e9a-50a9-496c-8167-31e4cfda82e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:48.799448 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Volume 86929df5-11f4-47e6-b556-4f68fb98918f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86929df5-11f4-47e6-b556-4f68fb98918f', 'volume_size': 2} Dec 11 21:06:48.800046 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] creating volume 'volume-86929df5-11f4-47e6-b556-4f68fb98918f' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:06:48.802071 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:48.946604 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:06:48.946986 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:06:48.949552 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fde4e9a-50a9-496c-8167-31e4cfda82e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86929df5-11f4-47e6-b556-4f68fb98918f', 'volume_size': 2}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:48.952008 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df9d731-2321-4ebb-8f02-c839fe2e901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:06:48.972790 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Volume volume-86929df5-11f4-47e6-b556-4f68fb98918f (86929df5-11f4-47e6-b556-4f68fb98918f): created successfully Dec 11 21:06:48.975763 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df9d731-2321-4ebb-8f02-c839fe2e901a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:06:48.978824 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Flow 'volume_create_manager' (a428ee8f-3384-4a6b-a0db-339b15b8b9fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:06:48.998469 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-79b15534-226e-4fe3-9e34-f12fb77896f8 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Created volume successfully. Dec 11 21:06:49.999072 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-26c48a32-ffc5-4075-98f5-810cdba50b8f tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:50.833724 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-26c48a32-ffc5-4075-98f5-810cdba50b8f tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Create snapshot completed successfully Dec 11 21:06:51.094342 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-348a9bc7-a13d-4099-b380-6e731c258a35 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Lock "b'cinder-59307d74-82ba-4b68-a460-121b64da5212-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:51.096023 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-348a9bc7-a13d-4099-b380-6e731c258a35 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:51.873807 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-348a9bc7-a13d-4099-b380-6e731c258a35 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Created reservations ['de9bd915-7de1-43c9-801b-beeedbf07a4d', 'f67507b9-f460-400a-ac32-802d0d8559c6', 'd4901f07-e7b6-400c-a817-98275b4c09cd', '43b3ae6c-ee5a-4f5b-9f38-d125f0c793a3'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:51.919102 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-348a9bc7-a13d-4099-b380-6e731c258a35 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Delete snapshot completed successfully. Dec 11 21:06:51.924405 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-348a9bc7-a13d-4099-b380-6e731c258a35 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Lock "b'cinder-59307d74-82ba-4b68-a460-121b64da5212-delete_snapshot'" released by "delete_snapshot" :: held 0.830s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:52.242103 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-ae77391d-3928-4bb4-bdf8-605cf0a74f26 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Lock "b'cinder-86929df5-11f4-47e6-b556-4f68fb98918f-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:06:52.308616 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ae77391d-3928-4bb4-bdf8-605cf0a74f26 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:52.379292 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ae77391d-3928-4bb4-bdf8-605cf0a74f26 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:06:52.379566 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ae77391d-3928-4bb4-bdf8-605cf0a74f26 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Volume volume-86929df5-11f4-47e6-b556-4f68fb98918f is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:06:52.390622 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ae77391d-3928-4bb4-bdf8-605cf0a74f26 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] deleting rbd volume volume-86929df5-11f4-47e6-b556-4f68fb98918f {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:06:52.832080 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-ae77391d-3928-4bb4-bdf8-605cf0a74f26 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Created reservations ['b90e9d4d-bb3a-4218-bc87-55c82303f2f5', '61bc8ba1-d39f-4692-92c4-ccb2fa4fcde9', '8f714458-379e-4d84-b701-9193a1561477', 'eb2d43a5-7e5f-456e-b51e-4cb6bd27a95b'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:06:52.884463 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ae77391d-3928-4bb4-bdf8-605cf0a74f26 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:52.919876 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ae77391d-3928-4bb4-bdf8-605cf0a74f26 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:52.975270 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-ae77391d-3928-4bb4-bdf8-605cf0a74f26 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:06:52.987040 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ae77391d-3928-4bb4-bdf8-605cf0a74f26 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Deleted volume successfully. Dec 11 21:06:53.007118 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-ae77391d-3928-4bb4-bdf8-605cf0a74f26 tempest-VolumesSnapshotNegativeTestJSON-1903441208 None] Lock "b'cinder-86929df5-11f4-47e6-b556-4f68fb98918f-delete_volume'" released by "delete_volume" :: held 0.765s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:06:55.841586 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:06:55.843706 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:55.913432 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:06:55.973502 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:07:12.154796 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-a6e45c26-9161-4edc-a810-1296b9747597 req-0c9fe461-2ca3-4d38-af75-2830ab254abf tempest-ServersTestBootFromVolume-308351442 None] Terminate volume connection completed successfully. Dec 11 21:07:12.155870 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a6e45c26-9161-4edc-a810-1296b9747597 req-0c9fe461-2ca3-4d38-af75-2830ab254abf tempest-ServersTestBootFromVolume-308351442 None] Deleting attachment e89959a4-bdd1-4e97-bbca-50089fb87323. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:07:12.328678 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-a6e45c26-9161-4edc-a810-1296b9747597 req-71deabd9-272f-45da-8da9-031ac392f140 tempest-ServersTestBootFromVolume-308351442 None] Lock "b'cinder-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:07:12.391604 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a6e45c26-9161-4edc-a810-1296b9747597 req-71deabd9-272f-45da-8da9-031ac392f140 tempest-ServersTestBootFromVolume-308351442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:07:12.550098 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a6e45c26-9161-4edc-a810-1296b9747597 req-71deabd9-272f-45da-8da9-031ac392f140 tempest-ServersTestBootFromVolume-308351442 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:07:12.567182 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a6e45c26-9161-4edc-a810-1296b9747597 req-71deabd9-272f-45da-8da9-031ac392f140 tempest-ServersTestBootFromVolume-308351442 None] deleting rbd volume volume-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:07:13.148409 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a6e45c26-9161-4edc-a810-1296b9747597 req-71deabd9-272f-45da-8da9-031ac392f140 tempest-ServersTestBootFromVolume-308351442 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:07:13.199053 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a6e45c26-9161-4edc-a810-1296b9747597 req-71deabd9-272f-45da-8da9-031ac392f140 tempest-ServersTestBootFromVolume-308351442 None] deleting parent snapshot volume-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:07:14.275263 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [req-a6e45c26-9161-4edc-a810-1296b9747597 req-71deabd9-272f-45da-8da9-031ac392f140 tempest-ServersTestBootFromVolume-308351442 None] Created reservations ['c5a4134f-d119-4816-92fb-1bda1aa35ddd', 'a35c28e9-c2e8-4956-9d26-7705c7980e0f', '87ac21a0-82ef-4a9d-8625-d408a7ed8723', 'b7e5bdc3-91a7-4ea2-8504-d6d3dfcd7f51'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:07:14.408088 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a6e45c26-9161-4edc-a810-1296b9747597 req-71deabd9-272f-45da-8da9-031ac392f140 tempest-ServersTestBootFromVolume-308351442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:07:14.484873 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a6e45c26-9161-4edc-a810-1296b9747597 req-71deabd9-272f-45da-8da9-031ac392f140 tempest-ServersTestBootFromVolume-308351442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:07:14.569196 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [req-a6e45c26-9161-4edc-a810-1296b9747597 req-71deabd9-272f-45da-8da9-031ac392f140 tempest-ServersTestBootFromVolume-308351442 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:07:14.575568 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-a6e45c26-9161-4edc-a810-1296b9747597 req-71deabd9-272f-45da-8da9-031ac392f140 tempest-ServersTestBootFromVolume-308351442 None] Deleted volume successfully. Dec 11 21:07:14.606949 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-a6e45c26-9161-4edc-a810-1296b9747597 req-71deabd9-272f-45da-8da9-031ac392f140 tempest-ServersTestBootFromVolume-308351442 None] Lock "b'cinder-d4cf6c7f-0e5a-4771-9c00-a456ed9aee8f-delete_volume'" released by "delete_volume" :: held 2.278s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:07:40.427222 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-e75f1d7b-15d3-48b0-b42e-c53bd69512a9 tempest-GroupsV320Test-1024203526 None] Group tempest-GroupsV320Test-Group-846534981: creating Dec 11 21:07:40.453794 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-e75f1d7b-15d3-48b0-b42e-c53bd69512a9 tempest-GroupsV320Test-1024203526 None] Group tempest-GroupsV320Test-Group-846534981: created successfully Dec 11 21:07:40.468555 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-e75f1d7b-15d3-48b0-b42e-c53bd69512a9 tempest-GroupsV320Test-1024203526 None] Create group completed successfully. Dec 11 21:07:42.163106 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-0656e262-2c1a-474f-9f9b-0994eb5c5221 tempest-GroupsV320Test-1024203526 None] Created reservations ['6cc96499-6e3e-472c-9963-ad0e3f50fe66'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:07:42.203486 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0656e262-2c1a-474f-9f9b-0994eb5c5221 tempest-GroupsV320Test-1024203526 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:07:42.240933 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0656e262-2c1a-474f-9f9b-0994eb5c5221 tempest-GroupsV320Test-1024203526 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:07:42.292433 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-0656e262-2c1a-474f-9f9b-0994eb5c5221 tempest-GroupsV320Test-1024203526 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:07:42.298255 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-0656e262-2c1a-474f-9f9b-0994eb5c5221 tempest-GroupsV320Test-1024203526 None] Delete group completed successfully. Dec 11 21:07:49.918702 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:07:49.923080 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:07:49.923631 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:07:49.937919 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Flow 'volume_create_manager' (e32dc0da-860b-4fac-a686-17444ff4a9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:07:49.943781 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac74f9ff-8c5e-4682-9788-825e44aaa309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:07:49.966002 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:07:49.981454 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac74f9ff-8c5e-4682-9788-825e44aaa309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-617193959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8ff8536d-b5c5-4945-b33d-fec35059e2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='577ad16d662d434f8fd27f4ede1be31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:07:50Z,use_quota=True,user_id='6e77b7cdb9394716a75fe27545e3c10c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:07:49.985949 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ce5a9d-2278-4110-8bc6-f394593ad3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:07:49.989609 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ce5a9d-2278-4110-8bc6-f394593ad3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:07:49.992384 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727ca410-b4aa-47e2-8849-2376286fb555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:07:49.994965 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727ca410-b4aa-47e2-8849-2376286fb555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff8536d-b5c5-4945-b33d-fec35059e2d7', 'volume_name': 'volume-8ff8536d-b5c5-4945-b33d-fec35059e2d7', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:07:49.997865 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbaf64a-cf4c-4faa-bf60-1ab55eb93999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:07:50.000345 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbaf64a-cf4c-4faa-bf60-1ab55eb93999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:07:50.002873 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824091e3-eaaa-465a-a124-c2b9b98c0a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:07:50.004531 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Volume 8ff8536d-b5c5-4945-b33d-fec35059e2d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff8536d-b5c5-4945-b33d-fec35059e2d7', 'volume_size': 1} Dec 11 21:07:50.005424 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] creating volume 'volume-8ff8536d-b5c5-4945-b33d-fec35059e2d7' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:07:50.006752 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:07:50.099158 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:07:50.099760 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:07:50.101920 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824091e3-eaaa-465a-a124-c2b9b98c0a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff8536d-b5c5-4945-b33d-fec35059e2d7', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:07:50.104252 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de483d19-ebc5-44af-a562-cc3484f621db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:07:50.128911 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Volume volume-8ff8536d-b5c5-4945-b33d-fec35059e2d7 (8ff8536d-b5c5-4945-b33d-fec35059e2d7): created successfully Dec 11 21:07:50.131161 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de483d19-ebc5-44af-a562-cc3484f621db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:07:50.135320 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Flow 'volume_create_manager' (e32dc0da-860b-4fac-a686-17444ff4a9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:07:50.152220 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f49576df-013f-4497-8793-c378585f11dd tempest-VolumesServicesTestJSON-651050963 None] Created volume successfully. Dec 11 21:07:51.117702 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c8ed2fe7-b70e-42b1-9c58-c732a6c794d8 tempest-VolumesServicesTestJSON-651050963 None] Lock "b'cinder-8ff8536d-b5c5-4945-b33d-fec35059e2d7-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:07:51.183031 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c8ed2fe7-b70e-42b1-9c58-c732a6c794d8 tempest-VolumesServicesTestJSON-651050963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:07:51.271789 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c8ed2fe7-b70e-42b1-9c58-c732a6c794d8 tempest-VolumesServicesTestJSON-651050963 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:07:51.272206 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c8ed2fe7-b70e-42b1-9c58-c732a6c794d8 tempest-VolumesServicesTestJSON-651050963 None] Volume volume-8ff8536d-b5c5-4945-b33d-fec35059e2d7 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:07:51.286079 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c8ed2fe7-b70e-42b1-9c58-c732a6c794d8 tempest-VolumesServicesTestJSON-651050963 None] deleting rbd volume volume-8ff8536d-b5c5-4945-b33d-fec35059e2d7 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:07:51.753603 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-c8ed2fe7-b70e-42b1-9c58-c732a6c794d8 tempest-VolumesServicesTestJSON-651050963 None] Created reservations ['abc9594e-0060-49ab-8c1a-6d6a30d537ea', '7199366b-e121-443a-9c3a-321590b2ca8d', '8eae2e0a-d8c8-415b-9ae5-13149af78296', '349ef977-0ad9-4134-8396-4895cbf87c11'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:07:51.818758 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c8ed2fe7-b70e-42b1-9c58-c732a6c794d8 tempest-VolumesServicesTestJSON-651050963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:07:51.870425 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c8ed2fe7-b70e-42b1-9c58-c732a6c794d8 tempest-VolumesServicesTestJSON-651050963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:07:51.941648 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-c8ed2fe7-b70e-42b1-9c58-c732a6c794d8 tempest-VolumesServicesTestJSON-651050963 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:07:51.947293 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c8ed2fe7-b70e-42b1-9c58-c732a6c794d8 tempest-VolumesServicesTestJSON-651050963 None] Deleted volume successfully. Dec 11 21:07:51.966753 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c8ed2fe7-b70e-42b1-9c58-c732a6c794d8 tempest-VolumesServicesTestJSON-651050963 None] Lock "b'cinder-8ff8536d-b5c5-4945-b33d-fec35059e2d7-delete_volume'" released by "delete_volume" :: held 0.849s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:07:55.839589 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:07:55.841568 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:07:55.930958 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:07:56.037058 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:07:59.754972 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:07:59.759620 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:07:59.760349 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:07:59.773658 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Flow 'volume_create_manager' (aeedd1ef-a6b8-421f-869e-242309685e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:07:59.778298 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6981340-06cd-40cb-b017-43bd0c964884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:07:59.806625 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:07:59.838449 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6981340-06cd-40cb-b017-43bd0c964884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1369098402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f75fa2d-f67b-4d3a-baf0-a910d2b1b316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573c59d926244a1bb60b51cc5f12d2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:08:00Z,use_quota=True,user_id='e4352e6538084f0f90a64e9eecdfc34b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da0f45c8-69a9-4744-b796-e7a2f067456f),volume_type_id=da0f45c8-69a9-4744-b796-e7a2f067456f)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:07:59.848860 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50687003-bbde-41d5-b56e-d155923bc5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:07:59.852432 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50687003-bbde-41d5-b56e-d155923bc5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:07:59.855649 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef42eac-c10e-4ec3-8b4b-0bf0561f829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:07:59.859201 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef42eac-c10e-4ec3-8b4b-0bf0561f829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f75fa2d-f67b-4d3a-baf0-a910d2b1b316', 'volume_name': 'volume-2f75fa2d-f67b-4d3a-baf0-a910d2b1b316', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:07:59.863499 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78ea52d-f917-43c4-a728-0822ff96cb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:07:59.866814 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78ea52d-f917-43c4-a728-0822ff96cb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:07:59.869898 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b0b9a1-d946-4bd5-98b3-099630120bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:07:59.871098 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Volume 2f75fa2d-f67b-4d3a-baf0-a910d2b1b316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f75fa2d-f67b-4d3a-baf0-a910d2b1b316', 'volume_size': 1} Dec 11 21:07:59.871646 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] creating volume 'volume-2f75fa2d-f67b-4d3a-baf0-a910d2b1b316' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:07:59.873955 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:07:59.970082 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] extra_specs: {} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:07:59.970690 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] extra_specs: {} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:07:59.974251 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b0b9a1-d946-4bd5-98b3-099630120bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f75fa2d-f67b-4d3a-baf0-a910d2b1b316', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:07:59.978284 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a3acc7-dcbf-4bd2-919c-d3999b374841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:07:59.990965 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Volume volume-2f75fa2d-f67b-4d3a-baf0-a910d2b1b316 (2f75fa2d-f67b-4d3a-baf0-a910d2b1b316): created successfully Dec 11 21:07:59.995453 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a3acc7-dcbf-4bd2-919c-d3999b374841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:00.000674 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Flow 'volume_create_manager' (aeedd1ef-a6b8-421f-869e-242309685e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:08:00.013217 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-6fc13eaa-d2e2-48a7-a23f-35a909993b3b tempest-VolumeTypesAccessTest-1523917369 None] Created volume successfully. Dec 11 21:08:01.321129 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] Lock "b'cinder-2f75fa2d-f67b-4d3a-baf0-a910d2b1b316-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:08:01.386288 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:01.462968 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:08:01.463622 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] Volume volume-2f75fa2d-f67b-4d3a-baf0-a910d2b1b316 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:08:01.484421 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] deleting rbd volume volume-2f75fa2d-f67b-4d3a-baf0-a910d2b1b316 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:08:01.851252 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-965348829 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-965348829, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:08:01.852479 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-965348829 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-965348829, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:08:01.886636 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] Created reservations ['13f97c72-75e2-4f54-acb0-e94a44aa7728', 'cfe6c565-bba0-4697-8745-3ed8153c49a7', '9c0bbe6a-4fa4-4fd5-a0c4-a25f9f18778d', '82ea9408-d680-4f48-bfef-5f50aa2cf1a8'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:08:01.963439 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:02.009954 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:02.051324 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:08:02.056330 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] Deleted volume successfully. Dec 11 21:08:02.070965 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-2ef8fba4-ea62-4005-89ef-3464aa5927e9 tempest-VolumeTypesAccessTest-1523917369 None] Lock "b'cinder-2f75fa2d-f67b-4d3a-baf0-a910d2b1b316-delete_volume'" released by "delete_volume" :: held 0.750s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:08:11.841023 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:08:11.847785 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:08:11.848886 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:08:11.875644 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Flow 'volume_create_manager' (216b9b13-e4c0-4e3d-b7d1-c55d08697218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:08:11.879215 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5d2ccf-9a9d-4e14-97bc-68b274f2f880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:11.890129 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:08:11.921791 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5d2ccf-9a9d-4e14-97bc-68b274f2f880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1625959190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=94ea4b5e-28a8-44a0-8c30-40ef94260806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514b32a4ffe641fdbe0683567ee39fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:08:12Z,use_quota=True,user_id='1ebc1d8756054407990f5aa65a5c5e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:11.926666 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa41e5e-a96a-4844-9fc8-ec4c1dbdbf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:11.930259 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa41e5e-a96a-4844-9fc8-ec4c1dbdbf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:11.933545 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa17f6a1-a86b-40ee-9336-db4c391e5cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:12.045927 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa17f6a1-a86b-40ee-9336-db4c391e5cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94ea4b5e-28a8-44a0-8c30-40ef94260806', 'volume_name': 'volume-94ea4b5e-28a8-44a0-8c30-40ef94260806', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:12.048674 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674c4250-2796-4b8a-af18-5f9d1da53896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:12.052551 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674c4250-2796-4b8a-af18-5f9d1da53896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:12.055346 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664a9cdb-fdf9-4311-a22e-c9c5f346f584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:12.056298 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Volume 94ea4b5e-28a8-44a0-8c30-40ef94260806: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94ea4b5e-28a8-44a0-8c30-40ef94260806', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 21:08:12.057049 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Cloning 94ea4b5e-28a8-44a0-8c30-40ef94260806 from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 21:08:12.069512 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:08:12.084285 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 8, 12, 74337)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:08:12.085022 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:08:12.085523 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 21:08:12.094125 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:08:12.097650 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 21:08:12.115306 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 8, 12, 108860)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:08:12.116205 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:08:12.116602 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 21:08:12.135691 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:12.222814 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] creating snapshot='volume-94ea4b5e-28a8-44a0-8c30-40ef94260806.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:08:13.258656 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-94ea4b5e-28a8-44a0-8c30-40ef94260806.clone_snap' to 'volume-94ea4b5e-28a8-44a0-8c30-40ef94260806' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:08:13.495457 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:08:13.497919 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:08:13.498359 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:08:13.536984 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:08:13.537640 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Marking volume 94ea4b5e-28a8-44a0-8c30-40ef94260806 as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:08:13.551557 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to 94ea4b5e-28a8-44a0-8c30-40ef94260806. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 21:08:13.551984 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Creating volume glance metadata for volume 94ea4b5e-28a8-44a0-8c30-40ef94260806 backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 21:08:13.641910 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664a9cdb-fdf9-4311-a22e-c9c5f346f584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ea4b5e-28a8-44a0-8c30-40ef94260806', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:13.644373 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050f6597-bac0-492f-8f99-7c59f0de9e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:13.659870 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Volume volume-94ea4b5e-28a8-44a0-8c30-40ef94260806 (94ea4b5e-28a8-44a0-8c30-40ef94260806): created successfully Dec 11 21:08:13.661822 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050f6597-bac0-492f-8f99-7c59f0de9e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:13.665167 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Flow 'volume_create_manager' (216b9b13-e4c0-4e3d-b7d1-c55d08697218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:08:13.677637 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9fcf39bb-685e-45d9-8d42-0cfa389d9809 tempest-VolumesExtendTest-445567556 None] Created volume successfully. Dec 11 21:08:14.222845 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a4dee0b4-3f6a-4434-b52f-f3b9f7add24a tempest-VolumesExtendTest-445567556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:14.490133 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a4dee0b4-3f6a-4434-b52f-f3b9f7add24a tempest-VolumesExtendTest-445567556 None] Extend volume from 1 GB to 2 GB. {{(pid=134173) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Dec 11 21:08:14.548660 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-a4dee0b4-3f6a-4434-b52f-f3b9f7add24a tempest-VolumesExtendTest-445567556 None] Extend volume completed successfully. Dec 11 21:08:15.952341 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:08:15.956942 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:08:15.957485 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:08:15.987845 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Flow 'volume_create_manager' (4343cc03-7d99-4a72-a4cb-73bc589ba18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:08:15.991659 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eba8bcf-14bd-4eaa-bec4-390c1e9a4397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:16.000123 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:08:16.014871 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eba8bcf-14bd-4eaa-bec4-390c1e9a4397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-203640187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a9acc23a-f8c7-44f2-8c01-a4da542c1d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514b32a4ffe641fdbe0683567ee39fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:08:16Z,use_quota=True,user_id='1ebc1d8756054407990f5aa65a5c5e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:16.018701 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88100386-e781-4a78-9798-fec5de759cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:16.020939 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88100386-e781-4a78-9798-fec5de759cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:16.023928 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78cc090-fee6-429d-96a0-73e2e062c71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:16.026523 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78cc090-fee6-429d-96a0-73e2e062c71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9acc23a-f8c7-44f2-8c01-a4da542c1d75', 'volume_name': 'volume-a9acc23a-f8c7-44f2-8c01-a4da542c1d75', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:16.029332 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe067c0-f362-4d4e-818a-3b503dde1618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:16.034762 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe067c0-f362-4d4e-818a-3b503dde1618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:16.038107 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e561440d-4065-4e16-be26-aa2576fc47ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:16.040009 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Volume a9acc23a-f8c7-44f2-8c01-a4da542c1d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9acc23a-f8c7-44f2-8c01-a4da542c1d75', 'volume_size': 1} Dec 11 21:08:16.040648 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] creating volume 'volume-a9acc23a-f8c7-44f2-8c01-a4da542c1d75' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:08:16.042270 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:16.181476 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:08:16.182125 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:08:16.184719 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e561440d-4065-4e16-be26-aa2576fc47ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9acc23a-f8c7-44f2-8c01-a4da542c1d75', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:16.187315 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a21d06-c88c-4797-8259-884816722225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:16.200605 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Volume volume-a9acc23a-f8c7-44f2-8c01-a4da542c1d75 (a9acc23a-f8c7-44f2-8c01-a4da542c1d75): created successfully Dec 11 21:08:16.203542 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a21d06-c88c-4797-8259-884816722225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:16.207437 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Flow 'volume_create_manager' (4343cc03-7d99-4a72-a4cb-73bc589ba18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:08:16.225873 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f21c1a7c-bf67-469c-a059-d3a0d444715c tempest-VolumesExtendTest-445567556 None] Created volume successfully. Dec 11 21:08:17.359876 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f32d9c04-883d-438c-8503-7c4e026795d0 tempest-VolumesExtendTest-445567556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:18.308018 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f32d9c04-883d-438c-8503-7c4e026795d0 tempest-VolumesExtendTest-445567556 None] Create snapshot completed successfully Dec 11 21:08:18.671115 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8a033643-21be-478d-a3fc-55ed84377382 tempest-VolumesExtendTest-445567556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:18.854854 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8a033643-21be-478d-a3fc-55ed84377382 tempest-VolumesExtendTest-445567556 None] Extend volume from 1 GB to 2 GB. {{(pid=134173) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Dec 11 21:08:18.888764 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8a033643-21be-478d-a3fc-55ed84377382 tempest-VolumesExtendTest-445567556 None] Extend volume completed successfully. Dec 11 21:08:20.114693 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-b6c39675-547f-45bd-b164-821754d4c15d tempest-VolumesExtendTest-445567556 None] Lock "b'cinder-0631d0a7-4fb3-4943-bd7c-bc49fd6e94a6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:08:20.118385 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b6c39675-547f-45bd-b164-821754d4c15d tempest-VolumesExtendTest-445567556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:20.646626 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-b6c39675-547f-45bd-b164-821754d4c15d tempest-VolumesExtendTest-445567556 None] Created reservations ['75df5aa3-72eb-42fa-a2fc-1ffa85d41bfc', 'c5970dc3-51cc-4c2e-9837-a8ed533295e7', '27960dd7-521a-48c6-9ce4-6ffe30bc5785', 'd22ea077-efe0-4b04-bbf9-94bfabe45816'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:08:20.777246 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b6c39675-547f-45bd-b164-821754d4c15d tempest-VolumesExtendTest-445567556 None] Delete snapshot completed successfully. Dec 11 21:08:20.786620 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-b6c39675-547f-45bd-b164-821754d4c15d tempest-VolumesExtendTest-445567556 None] Lock "b'cinder-0631d0a7-4fb3-4943-bd7c-bc49fd6e94a6-delete_snapshot'" released by "delete_snapshot" :: held 0.672s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:08:21.329389 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-aa749a71-f9b1-4412-a07d-8882007e3906 tempest-VolumesExtendTest-445567556 None] Lock "b'cinder-a9acc23a-f8c7-44f2-8c01-a4da542c1d75-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:08:21.397509 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-aa749a71-f9b1-4412-a07d-8882007e3906 tempest-VolumesExtendTest-445567556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:21.472779 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-aa749a71-f9b1-4412-a07d-8882007e3906 tempest-VolumesExtendTest-445567556 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:08:21.473454 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-aa749a71-f9b1-4412-a07d-8882007e3906 tempest-VolumesExtendTest-445567556 None] Volume volume-a9acc23a-f8c7-44f2-8c01-a4da542c1d75 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:08:21.484183 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-aa749a71-f9b1-4412-a07d-8882007e3906 tempest-VolumesExtendTest-445567556 None] deleting rbd volume volume-a9acc23a-f8c7-44f2-8c01-a4da542c1d75 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:08:21.929504 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-aa749a71-f9b1-4412-a07d-8882007e3906 tempest-VolumesExtendTest-445567556 None] Created reservations ['3e04bae8-b025-4ee8-ae87-683477e8d4ea', '7c456738-a0fa-48b7-999e-f75a6b50facf', 'f0b2521b-c1c0-4946-8036-fc0a2ea7a9fc', '5477bf60-482f-4299-9a8a-602d7c16e4d1'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:08:22.061291 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-aa749a71-f9b1-4412-a07d-8882007e3906 tempest-VolumesExtendTest-445567556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:22.160005 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-aa749a71-f9b1-4412-a07d-8882007e3906 tempest-VolumesExtendTest-445567556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:22.229040 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-aa749a71-f9b1-4412-a07d-8882007e3906 tempest-VolumesExtendTest-445567556 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:08:22.233904 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-aa749a71-f9b1-4412-a07d-8882007e3906 tempest-VolumesExtendTest-445567556 None] Deleted volume successfully. Dec 11 21:08:22.261285 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-aa749a71-f9b1-4412-a07d-8882007e3906 tempest-VolumesExtendTest-445567556 None] Lock "b'cinder-a9acc23a-f8c7-44f2-8c01-a4da542c1d75-delete_volume'" released by "delete_volume" :: held 0.932s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:08:22.511881 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-cc06a4e4-84d9-49e7-b839-84af7ae9fa24 tempest-VolumesExtendTest-445567556 None] Lock "b'cinder-94ea4b5e-28a8-44a0-8c30-40ef94260806-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:08:22.576641 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cc06a4e4-84d9-49e7-b839-84af7ae9fa24 tempest-VolumesExtendTest-445567556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:22.812907 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cc06a4e4-84d9-49e7-b839-84af7ae9fa24 tempest-VolumesExtendTest-445567556 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:08:22.835479 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cc06a4e4-84d9-49e7-b839-84af7ae9fa24 tempest-VolumesExtendTest-445567556 None] deleting rbd volume volume-94ea4b5e-28a8-44a0-8c30-40ef94260806 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:08:23.242837 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cc06a4e4-84d9-49e7-b839-84af7ae9fa24 tempest-VolumesExtendTest-445567556 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:08:23.304196 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cc06a4e4-84d9-49e7-b839-84af7ae9fa24 tempest-VolumesExtendTest-445567556 None] deleting parent snapshot volume-94ea4b5e-28a8-44a0-8c30-40ef94260806.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:08:24.309883 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-cc06a4e4-84d9-49e7-b839-84af7ae9fa24 tempest-VolumesExtendTest-445567556 None] Created reservations ['5565abe7-895f-495a-8edd-02e49d100334', 'be2bbf16-d071-4797-afcd-68db08233682', 'cd1d8eb0-70c6-489f-b6c3-eb9622d89575', '944f6d39-f887-4503-aec9-08698ab7855c'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:08:24.366465 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cc06a4e4-84d9-49e7-b839-84af7ae9fa24 tempest-VolumesExtendTest-445567556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:24.447080 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cc06a4e4-84d9-49e7-b839-84af7ae9fa24 tempest-VolumesExtendTest-445567556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:24.518340 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-cc06a4e4-84d9-49e7-b839-84af7ae9fa24 tempest-VolumesExtendTest-445567556 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:08:24.524771 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-cc06a4e4-84d9-49e7-b839-84af7ae9fa24 tempest-VolumesExtendTest-445567556 None] Deleted volume successfully. Dec 11 21:08:24.563263 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-cc06a4e4-84d9-49e7-b839-84af7ae9fa24 tempest-VolumesExtendTest-445567556 None] Lock "b'cinder-94ea4b5e-28a8-44a0-8c30-40ef94260806-delete_volume'" released by "delete_volume" :: held 2.042s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:08:36.014344 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:08:36.036881 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:08:36.037710 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:08:36.075155 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Flow 'volume_create_manager' (f199ee7b-1359-4e91-ab3c-74810fcd1b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:08:36.081149 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f33057-6948-46c4-8b7b-972a0a9698e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:36.087825 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:08:36.105882 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f33057-6948-46c4-8b7b-972a0a9698e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1988474742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=af62f7be-16aa-4481-8b27-734592d4b6d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2af24254f9044d5ab6d75e304dd077bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:08:36Z,use_quota=True,user_id='2b4cffa90d4f4c31b67da9862dc0d953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:36.108798 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b629d620-87c7-422c-95b6-80b65ad1d619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:36.130623 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b629d620-87c7-422c-95b6-80b65ad1d619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:36.134233 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4aca9fc-ed67-4d88-8883-5dfa299dc3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:36.136659 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4aca9fc-ed67-4d88-8883-5dfa299dc3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af62f7be-16aa-4481-8b27-734592d4b6d5', 'volume_name': 'volume-af62f7be-16aa-4481-8b27-734592d4b6d5', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:36.139379 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbaedf6a-016c-4b2d-b29f-92ebae456ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:36.141680 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbaedf6a-016c-4b2d-b29f-92ebae456ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:36.144774 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9998fc20-f1a5-4a33-8852-67e02b82d5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:36.145616 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Volume af62f7be-16aa-4481-8b27-734592d4b6d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af62f7be-16aa-4481-8b27-734592d4b6d5', 'volume_size': 1} Dec 11 21:08:36.145985 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] creating volume 'volume-af62f7be-16aa-4481-8b27-734592d4b6d5' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:08:36.146987 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:36.234293 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:08:36.234807 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:08:36.237946 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9998fc20-f1a5-4a33-8852-67e02b82d5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af62f7be-16aa-4481-8b27-734592d4b6d5', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:36.240406 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3cc049-b760-4443-a499-09c7fc527420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:36.283402 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Volume volume-af62f7be-16aa-4481-8b27-734592d4b6d5 (af62f7be-16aa-4481-8b27-734592d4b6d5): created successfully Dec 11 21:08:36.315973 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3cc049-b760-4443-a499-09c7fc527420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:36.327415 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Flow 'volume_create_manager' (f199ee7b-1359-4e91-ab3c-74810fcd1b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:08:36.352010 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-e863c800-4f88-462a-9313-8b860da7b835 req-69eb4629-33f4-4612-bee8-2ee40a10caf2 tempest-VolumesGetTestJSON-566803659 None] Created volume successfully. Dec 11 21:08:37.258564 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-a42dc999-e9fb-401e-a963-78a349634bc4 req-be0e2986-fa72-4346-b9f6-d10916559ff8 tempest-VolumesGetTestJSON-566803659 None] Lock "b'cinder-af62f7be-16aa-4481-8b27-734592d4b6d5-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:08:37.324233 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a42dc999-e9fb-401e-a963-78a349634bc4 req-be0e2986-fa72-4346-b9f6-d10916559ff8 tempest-VolumesGetTestJSON-566803659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:37.378824 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a42dc999-e9fb-401e-a963-78a349634bc4 req-be0e2986-fa72-4346-b9f6-d10916559ff8 tempest-VolumesGetTestJSON-566803659 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:08:37.379491 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a42dc999-e9fb-401e-a963-78a349634bc4 req-be0e2986-fa72-4346-b9f6-d10916559ff8 tempest-VolumesGetTestJSON-566803659 None] Volume volume-af62f7be-16aa-4481-8b27-734592d4b6d5 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:08:37.388139 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a42dc999-e9fb-401e-a963-78a349634bc4 req-be0e2986-fa72-4346-b9f6-d10916559ff8 tempest-VolumesGetTestJSON-566803659 None] deleting rbd volume volume-af62f7be-16aa-4481-8b27-734592d4b6d5 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:08:37.813411 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [req-a42dc999-e9fb-401e-a963-78a349634bc4 req-be0e2986-fa72-4346-b9f6-d10916559ff8 tempest-VolumesGetTestJSON-566803659 None] Created reservations ['9e164a9b-8ab8-4b8f-aca5-af9a9c913252', '4a68f75b-d88d-4fe0-ad6f-d930ad0daa2c', 'bcc29998-f10b-4ee6-9e60-baef2b61a6b8', 'e668e961-b135-4bee-a977-f05a7264404f'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:08:37.883797 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a42dc999-e9fb-401e-a963-78a349634bc4 req-be0e2986-fa72-4346-b9f6-d10916559ff8 tempest-VolumesGetTestJSON-566803659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:37.932644 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a42dc999-e9fb-401e-a963-78a349634bc4 req-be0e2986-fa72-4346-b9f6-d10916559ff8 tempest-VolumesGetTestJSON-566803659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:38.000671 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [req-a42dc999-e9fb-401e-a963-78a349634bc4 req-be0e2986-fa72-4346-b9f6-d10916559ff8 tempest-VolumesGetTestJSON-566803659 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:08:38.006667 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-a42dc999-e9fb-401e-a963-78a349634bc4 req-be0e2986-fa72-4346-b9f6-d10916559ff8 tempest-VolumesGetTestJSON-566803659 None] Deleted volume successfully. Dec 11 21:08:38.021051 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-a42dc999-e9fb-401e-a963-78a349634bc4 req-be0e2986-fa72-4346-b9f6-d10916559ff8 tempest-VolumesGetTestJSON-566803659 None] Lock "b'cinder-af62f7be-16aa-4481-8b27-734592d4b6d5-delete_volume'" released by "delete_volume" :: held 0.762s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:08:42.399182 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:08:42.404997 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:08:42.406211 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:08:42.427364 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Flow 'volume_create_manager' (bd4f871d-d159-48cf-a063-9452da8bb744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:08:42.430969 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d26ae86-a67f-460d-b7c0-a35708799dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:42.438263 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:08:42.455132 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d26ae86-a67f-460d-b7c0-a35708799dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-829832792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2d7dc747-161e-49e9-961a-1a97814210ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cc0fb5a98d405584c05509f7eaf419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:08:42Z,use_quota=True,user_id='369dc9c259574852b00d4c06cd9dea53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:42.458098 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b307b7-0246-4f88-9bc4-82322d45aa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:42.460837 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b307b7-0246-4f88-9bc4-82322d45aa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:42.463686 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e20e77a-6551-4e8a-b8b2-a1e21794ff2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:42.466002 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e20e77a-6551-4e8a-b8b2-a1e21794ff2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d7dc747-161e-49e9-961a-1a97814210ee', 'volume_name': 'volume-2d7dc747-161e-49e9-961a-1a97814210ee', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:42.468477 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab8b0ff-d04c-449c-869e-bb836df27dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:42.471500 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab8b0ff-d04c-449c-869e-bb836df27dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:42.474402 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1db401-b235-45bb-a36d-d0d366b4cab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:42.475378 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Volume 2d7dc747-161e-49e9-961a-1a97814210ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d7dc747-161e-49e9-961a-1a97814210ee', 'volume_size': 1} Dec 11 21:08:42.475933 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] creating volume 'volume-2d7dc747-161e-49e9-961a-1a97814210ee' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:08:42.477080 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:42.585079 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:08:42.585845 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:08:42.589253 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1db401-b235-45bb-a36d-d0d366b4cab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7dc747-161e-49e9-961a-1a97814210ee', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:42.592096 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bff7bde-566e-4e1d-b969-6d8315e84d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:08:42.602444 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Volume volume-2d7dc747-161e-49e9-961a-1a97814210ee (2d7dc747-161e-49e9-961a-1a97814210ee): created successfully Dec 11 21:08:42.604879 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bff7bde-566e-4e1d-b969-6d8315e84d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:08:42.608372 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Flow 'volume_create_manager' (bd4f871d-d159-48cf-a063-9452da8bb744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:08:42.620522 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-a35c794e-aad3-4f6f-a568-1e250a82e554 req-02ce3e48-7787-4acf-8029-f14494b07958 tempest-VolumesSnapshotsTestJSON-440060869 None] Created volume successfully. Dec 11 21:08:43.767533 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-90794fe4-072f-4947-aeec-b61768020731 req-3b416d38-6d6d-4122-9323-cad1669d3bdd tempest-VolumesSnapshotsTestJSON-440060869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:44.327147 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-90794fe4-072f-4947-aeec-b61768020731 req-3b416d38-6d6d-4122-9323-cad1669d3bdd tempest-VolumesSnapshotsTestJSON-440060869 None] Create snapshot completed successfully Dec 11 21:08:45.040361 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-0ac0c85e-f663-4e16-bc9a-04ff6222a776 req-7d82beb3-784f-42af-9101-79a6bd38a85a tempest-VolumesSnapshotsTestJSON-440060869 None] Lock "b'cinder-38149e97-9cf5-4ef6-af74-7c7f3d6a9f46-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:08:45.041945 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-0ac0c85e-f663-4e16-bc9a-04ff6222a776 req-7d82beb3-784f-42af-9101-79a6bd38a85a tempest-VolumesSnapshotsTestJSON-440060869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:45.358249 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [req-0ac0c85e-f663-4e16-bc9a-04ff6222a776 req-7d82beb3-784f-42af-9101-79a6bd38a85a tempest-VolumesSnapshotsTestJSON-440060869 None] Created reservations ['e363d4b3-3d26-4002-9d7f-85e30ee7280f', '5c1e5946-4dd1-4877-93df-2d5dbd2f3bad', '83f7f405-e6a0-46bb-8335-6b7513dbc0bd', '25d3d76e-aae2-4d13-a122-ef2db2b41427'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:08:45.404986 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-0ac0c85e-f663-4e16-bc9a-04ff6222a776 req-7d82beb3-784f-42af-9101-79a6bd38a85a tempest-VolumesSnapshotsTestJSON-440060869 None] Delete snapshot completed successfully. Dec 11 21:08:45.411278 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-0ac0c85e-f663-4e16-bc9a-04ff6222a776 req-7d82beb3-784f-42af-9101-79a6bd38a85a tempest-VolumesSnapshotsTestJSON-440060869 None] Lock "b'cinder-38149e97-9cf5-4ef6-af74-7c7f3d6a9f46-delete_snapshot'" released by "delete_snapshot" :: held 0.371s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:08:46.235382 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-42a5005b-d2c5-492a-96cc-dbaa01ece86e req-81597c0e-cc3f-48f6-b1f7-9feaa619cb1f tempest-VolumesSnapshotsTestJSON-440060869 None] Lock "b'cinder-2d7dc747-161e-49e9-961a-1a97814210ee-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:08:46.320402 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-42a5005b-d2c5-492a-96cc-dbaa01ece86e req-81597c0e-cc3f-48f6-b1f7-9feaa619cb1f tempest-VolumesSnapshotsTestJSON-440060869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:46.394858 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-42a5005b-d2c5-492a-96cc-dbaa01ece86e req-81597c0e-cc3f-48f6-b1f7-9feaa619cb1f tempest-VolumesSnapshotsTestJSON-440060869 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:08:46.395282 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-42a5005b-d2c5-492a-96cc-dbaa01ece86e req-81597c0e-cc3f-48f6-b1f7-9feaa619cb1f tempest-VolumesSnapshotsTestJSON-440060869 None] Volume volume-2d7dc747-161e-49e9-961a-1a97814210ee is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:08:46.408309 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-42a5005b-d2c5-492a-96cc-dbaa01ece86e req-81597c0e-cc3f-48f6-b1f7-9feaa619cb1f tempest-VolumesSnapshotsTestJSON-440060869 None] deleting rbd volume volume-2d7dc747-161e-49e9-961a-1a97814210ee {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:08:46.815125 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [req-42a5005b-d2c5-492a-96cc-dbaa01ece86e req-81597c0e-cc3f-48f6-b1f7-9feaa619cb1f tempest-VolumesSnapshotsTestJSON-440060869 None] Created reservations ['a9db753f-53e2-49d2-bf43-d21e443578f4', '4cbac6e8-e703-434a-b4d4-dee568256c77', '3ab20613-6dcb-485e-bffc-36d579431385', 'f9e7d146-1436-4c1d-b0e9-7224e14e4cb4'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:08:46.883335 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-42a5005b-d2c5-492a-96cc-dbaa01ece86e req-81597c0e-cc3f-48f6-b1f7-9feaa619cb1f tempest-VolumesSnapshotsTestJSON-440060869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:46.934198 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-42a5005b-d2c5-492a-96cc-dbaa01ece86e req-81597c0e-cc3f-48f6-b1f7-9feaa619cb1f tempest-VolumesSnapshotsTestJSON-440060869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:46.977349 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [req-42a5005b-d2c5-492a-96cc-dbaa01ece86e req-81597c0e-cc3f-48f6-b1f7-9feaa619cb1f tempest-VolumesSnapshotsTestJSON-440060869 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:08:46.985961 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-42a5005b-d2c5-492a-96cc-dbaa01ece86e req-81597c0e-cc3f-48f6-b1f7-9feaa619cb1f tempest-VolumesSnapshotsTestJSON-440060869 None] Deleted volume successfully. Dec 11 21:08:47.002886 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-42a5005b-d2c5-492a-96cc-dbaa01ece86e req-81597c0e-cc3f-48f6-b1f7-9feaa619cb1f tempest-VolumesSnapshotsTestJSON-440060869 None] Lock "b'cinder-2d7dc747-161e-49e9-961a-1a97814210ee-delete_volume'" released by "delete_volume" :: held 0.766s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:08:55.845564 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:08:55.848572 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:55.909375 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:08:55.984175 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:09:55.843197 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:09:55.844790 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:09:55.880851 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:09:55.930733 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:10:08.578531 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0417273a-599a-498e-b0ea-86aad4c27338 tempest-BackendsCapabilitiesAdminTestsJSON-2036315772 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:6e8f856c-f0dd-4f2b-b584-866af3a1c6ae:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134173) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Dec 11 21:10:08.617261 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ea39fcb0-3fd3-4d45-9596-653ce14901c9 tempest-BackendsCapabilitiesAdminTestsJSON-2036315772 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:6e8f856c-f0dd-4f2b-b584-866af3a1c6ae:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134173) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Dec 11 21:10:24.813283 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:10:24.817089 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:10:24.817433 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:10:24.830404 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Flow 'volume_create_manager' (a79e8aff-490d-4ac9-ab5d-f36cf63a1c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:24.833659 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99f8412-dbf2-46fc-bd3d-899687b4b613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:24.839860 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:10:24.852662 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99f8412-dbf2-46fc-bd3d-899687b4b613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-278718283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a04dad6e-9d40-4352-ac96-075fe6c9bca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d2b596a6b9438f94c7be37cf9d3767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:10:25Z,use_quota=True,user_id='67f383dbb6d946b89bf54977d2885f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:24.855316 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d50d22-4af0-41fe-91b0-fa8c184bc881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:24.857531 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d50d22-4af0-41fe-91b0-fa8c184bc881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:24.859986 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1258cc-78ca-4dad-997b-2cbe605df9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:24.862251 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1258cc-78ca-4dad-997b-2cbe605df9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a04dad6e-9d40-4352-ac96-075fe6c9bca8', 'volume_name': 'volume-a04dad6e-9d40-4352-ac96-075fe6c9bca8', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:24.864610 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf75844-74b1-492f-b75d-7eb3c7e3e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:24.866784 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf75844-74b1-492f-b75d-7eb3c7e3e393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:24.869042 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfde07f-dc6a-450e-9228-30865a4cc822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:24.869821 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Volume a04dad6e-9d40-4352-ac96-075fe6c9bca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a04dad6e-9d40-4352-ac96-075fe6c9bca8', 'volume_size': 1} Dec 11 21:10:24.870207 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] creating volume 'volume-a04dad6e-9d40-4352-ac96-075fe6c9bca8' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:10:24.871200 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:24.929329 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:10:24.929706 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:10:24.931875 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfde07f-dc6a-450e-9228-30865a4cc822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a04dad6e-9d40-4352-ac96-075fe6c9bca8', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:24.934096 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd49a31-ee95-424f-80a5-0b7f68b12784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:24.944108 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Volume volume-a04dad6e-9d40-4352-ac96-075fe6c9bca8 (a04dad6e-9d40-4352-ac96-075fe6c9bca8): created successfully Dec 11 21:10:24.946155 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd49a31-ee95-424f-80a5-0b7f68b12784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:24.949308 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Flow 'volume_create_manager' (a79e8aff-490d-4ac9-ab5d-f36cf63a1c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:24.957163 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-0199f4ea-7802-410a-a6c7-e5cd5248f76d tempest-VolumesMetadataTest-2014252962 None] Created volume successfully. Dec 11 21:10:26.421343 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-4d16cb2b-7829-45b2-afbc-07a3ced2ebf5 tempest-VolumesMetadataTest-2014252962 None] Lock "b'cinder-a04dad6e-9d40-4352-ac96-075fe6c9bca8-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:10:26.473418 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4d16cb2b-7829-45b2-afbc-07a3ced2ebf5 tempest-VolumesMetadataTest-2014252962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:26.561352 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4d16cb2b-7829-45b2-afbc-07a3ced2ebf5 tempest-VolumesMetadataTest-2014252962 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:10:26.561773 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4d16cb2b-7829-45b2-afbc-07a3ced2ebf5 tempest-VolumesMetadataTest-2014252962 None] Volume volume-a04dad6e-9d40-4352-ac96-075fe6c9bca8 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:10:26.570157 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4d16cb2b-7829-45b2-afbc-07a3ced2ebf5 tempest-VolumesMetadataTest-2014252962 None] deleting rbd volume volume-a04dad6e-9d40-4352-ac96-075fe6c9bca8 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:10:26.781409 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-4d16cb2b-7829-45b2-afbc-07a3ced2ebf5 tempest-VolumesMetadataTest-2014252962 None] Created reservations ['6795fc17-1ec2-44b1-a885-3bb1b2c4b9a7', 'cf97f309-b518-4c6d-93ce-0414f17fdd0f', 'b6581472-ff36-4b34-814c-b06efbee54de', '4960243b-1ec9-4550-b13b-2a513ae1bf62'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:10:26.821834 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4d16cb2b-7829-45b2-afbc-07a3ced2ebf5 tempest-VolumesMetadataTest-2014252962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:26.850106 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4d16cb2b-7829-45b2-afbc-07a3ced2ebf5 tempest-VolumesMetadataTest-2014252962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:26.882184 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-4d16cb2b-7829-45b2-afbc-07a3ced2ebf5 tempest-VolumesMetadataTest-2014252962 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:10:26.887434 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4d16cb2b-7829-45b2-afbc-07a3ced2ebf5 tempest-VolumesMetadataTest-2014252962 None] Deleted volume successfully. Dec 11 21:10:26.900071 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-4d16cb2b-7829-45b2-afbc-07a3ced2ebf5 tempest-VolumesMetadataTest-2014252962 None] Lock "b'cinder-a04dad6e-9d40-4352-ac96-075fe6c9bca8-delete_volume'" released by "delete_volume" :: held 0.480s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:10:30.434017 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:10:30.437540 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:10:30.437981 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:10:30.449707 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Flow 'volume_create_manager' (45489034-6bf5-484f-92c2-e8d65d9eae84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:30.453793 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d414335-1751-4805-a17c-2d5fdcc5f140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:30.460074 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:10:30.473592 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d414335-1751-4805-a17c-2d5fdcc5f140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1751367798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d11c3d7a-08a9-4b14-836b-268cb8d2af62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97e448462bb643d592668f21fd7e80b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:10:30Z,use_quota=True,user_id='4eec159de7f14ed5af33da964dfae4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:30.476189 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8f13ee-d48e-4ceb-b176-6d0333b84be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:30.478328 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8f13ee-d48e-4ceb-b176-6d0333b84be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:30.480762 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f070eb-70d0-4f58-8eb8-6a08848651e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:30.483648 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f070eb-70d0-4f58-8eb8-6a08848651e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd11c3d7a-08a9-4b14-836b-268cb8d2af62', 'volume_name': 'volume-d11c3d7a-08a9-4b14-836b-268cb8d2af62', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:30.485949 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a86f228-608c-486d-84a6-b7073ad0bf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:30.488130 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a86f228-608c-486d-84a6-b7073ad0bf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:30.490377 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c104835-0f53-4778-9ddf-f0c42c447cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:30.491179 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Volume d11c3d7a-08a9-4b14-836b-268cb8d2af62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d11c3d7a-08a9-4b14-836b-268cb8d2af62', 'volume_size': 1} Dec 11 21:10:30.491565 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] creating volume 'volume-d11c3d7a-08a9-4b14-836b-268cb8d2af62' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:10:30.492525 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:30.546141 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:10:30.546557 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:10:30.548597 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c104835-0f53-4778-9ddf-f0c42c447cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d11c3d7a-08a9-4b14-836b-268cb8d2af62', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:30.550812 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce38e65-6142-4c4a-93ff-478af0c2f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:30.559343 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Volume volume-d11c3d7a-08a9-4b14-836b-268cb8d2af62 (d11c3d7a-08a9-4b14-836b-268cb8d2af62): created successfully Dec 11 21:10:30.561308 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce38e65-6142-4c4a-93ff-478af0c2f665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:30.564373 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Flow 'volume_create_manager' (45489034-6bf5-484f-92c2-e8d65d9eae84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:30.573675 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ebdc7250-75c3-4221-8e94-8f55f79095da tempest-VolumesTransfersV355Test-1412325425 None] Created volume successfully. Dec 11 21:10:32.084293 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b80356a0-76af-413a-a4d4-278190ee7854 tempest-VolumesTransfersV355Test-1553377 None] Transfer volume completed successfully. Dec 11 21:10:32.519149 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-76bd9dc6-8b83-4526-b1b8-ac19e3a47e50 tempest-VolumesTransfersV355Test-295471338 None] Lock "b'cinder-d11c3d7a-08a9-4b14-836b-268cb8d2af62-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:10:32.546960 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-76bd9dc6-8b83-4526-b1b8-ac19e3a47e50 tempest-VolumesTransfersV355Test-295471338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:32.585510 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-76bd9dc6-8b83-4526-b1b8-ac19e3a47e50 tempest-VolumesTransfersV355Test-295471338 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:10:32.585933 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-76bd9dc6-8b83-4526-b1b8-ac19e3a47e50 tempest-VolumesTransfersV355Test-295471338 None] Volume volume-d11c3d7a-08a9-4b14-836b-268cb8d2af62 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:10:32.591444 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-76bd9dc6-8b83-4526-b1b8-ac19e3a47e50 tempest-VolumesTransfersV355Test-295471338 None] deleting rbd volume volume-d11c3d7a-08a9-4b14-836b-268cb8d2af62 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:10:32.884530 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-76bd9dc6-8b83-4526-b1b8-ac19e3a47e50 tempest-VolumesTransfersV355Test-295471338 None] Created reservations ['72a39660-bfa4-4122-af70-c440b91b34a6', 'e17c3fbd-2ecd-4059-8dbf-0f48983d399b', 'a06dde0b-be0c-4944-9e25-62dd5986cff6', 'ded03604-4d2b-43ec-8f03-0cd0818be495'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:10:32.947356 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-76bd9dc6-8b83-4526-b1b8-ac19e3a47e50 tempest-VolumesTransfersV355Test-295471338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:33.006099 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-76bd9dc6-8b83-4526-b1b8-ac19e3a47e50 tempest-VolumesTransfersV355Test-295471338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:33.060490 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-76bd9dc6-8b83-4526-b1b8-ac19e3a47e50 tempest-VolumesTransfersV355Test-295471338 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:10:33.065671 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-76bd9dc6-8b83-4526-b1b8-ac19e3a47e50 tempest-VolumesTransfersV355Test-295471338 None] Deleted volume successfully. Dec 11 21:10:33.080022 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-76bd9dc6-8b83-4526-b1b8-ac19e3a47e50 tempest-VolumesTransfersV355Test-295471338 None] Lock "b'cinder-d11c3d7a-08a9-4b14-836b-268cb8d2af62-delete_volume'" released by "delete_volume" :: held 0.561s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:10:33.992243 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:10:33.996897 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:10:33.997629 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:10:34.009720 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Flow 'volume_create_manager' (a02b54fd-2d42-4950-8ac9-5135a3aa5057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:34.013062 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2a7827-8d94-4e11-bea5-8e8c6c9490e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:34.019655 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:10:34.033520 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2a7827-8d94-4e11-bea5-8e8c6c9490e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1237419410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=812b0af1-dc10-487e-bee7-144d9c2c1ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97e448462bb643d592668f21fd7e80b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:10:34Z,use_quota=True,user_id='4eec159de7f14ed5af33da964dfae4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:34.036172 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab163fe8-fe4b-4f3d-a88d-af3f0e3aba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:34.038421 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab163fe8-fe4b-4f3d-a88d-af3f0e3aba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:34.040870 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c169243d-b712-4b9f-bbb2-02dcee2c6a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:34.044580 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c169243d-b712-4b9f-bbb2-02dcee2c6a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '812b0af1-dc10-487e-bee7-144d9c2c1ab5', 'volume_name': 'volume-812b0af1-dc10-487e-bee7-144d9c2c1ab5', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:34.047255 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59b1afac-2db8-4936-9fd6-5ca2d882d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:34.049594 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59b1afac-2db8-4936-9fd6-5ca2d882d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:34.052297 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98da0e8a-cf7a-4cc3-afec-5329ba49667c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:34.053246 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Volume 812b0af1-dc10-487e-bee7-144d9c2c1ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-812b0af1-dc10-487e-bee7-144d9c2c1ab5', 'volume_size': 1} Dec 11 21:10:34.053789 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] creating volume 'volume-812b0af1-dc10-487e-bee7-144d9c2c1ab5' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:10:34.054964 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:34.125679 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:10:34.126058 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:10:34.128375 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98da0e8a-cf7a-4cc3-afec-5329ba49667c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-812b0af1-dc10-487e-bee7-144d9c2c1ab5', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:34.130658 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d27c58-f70d-4fc6-abf6-c9b8c28c3233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:34.142136 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Volume volume-812b0af1-dc10-487e-bee7-144d9c2c1ab5 (812b0af1-dc10-487e-bee7-144d9c2c1ab5): created successfully Dec 11 21:10:34.145245 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d27c58-f70d-4fc6-abf6-c9b8c28c3233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:34.148428 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Flow 'volume_create_manager' (a02b54fd-2d42-4950-8ac9-5135a3aa5057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:34.158220 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9f755d77-7528-42f7-82e5-b2b3855b9154 tempest-VolumesTransfersV355Test-1412325425 None] Created volume successfully. Dec 11 21:10:35.338335 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-2147dd78-237f-47e5-82c9-0249dc978857 tempest-VolumesTransfersV355Test-295471338 None] Lock "b'cinder-812b0af1-dc10-487e-bee7-144d9c2c1ab5-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:10:35.386139 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2147dd78-237f-47e5-82c9-0249dc978857 tempest-VolumesTransfersV355Test-295471338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:35.439168 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2147dd78-237f-47e5-82c9-0249dc978857 tempest-VolumesTransfersV355Test-295471338 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:10:35.439680 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2147dd78-237f-47e5-82c9-0249dc978857 tempest-VolumesTransfersV355Test-295471338 None] Volume volume-812b0af1-dc10-487e-bee7-144d9c2c1ab5 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:10:35.450568 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2147dd78-237f-47e5-82c9-0249dc978857 tempest-VolumesTransfersV355Test-295471338 None] deleting rbd volume volume-812b0af1-dc10-487e-bee7-144d9c2c1ab5 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:10:35.752168 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-2147dd78-237f-47e5-82c9-0249dc978857 tempest-VolumesTransfersV355Test-295471338 None] Created reservations ['dde34563-fdd6-4cc3-a31d-be9c760f5813', 'f6c44b22-65e4-4739-bce2-2bb7822276e5', '78e66eb3-a526-4779-aa54-f9eecd79706f', 'a7fdb25f-5d08-4933-9097-6bba856bddcd'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:10:35.801803 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2147dd78-237f-47e5-82c9-0249dc978857 tempest-VolumesTransfersV355Test-295471338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:35.853342 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2147dd78-237f-47e5-82c9-0249dc978857 tempest-VolumesTransfersV355Test-295471338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:35.888372 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-2147dd78-237f-47e5-82c9-0249dc978857 tempest-VolumesTransfersV355Test-295471338 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:10:35.892432 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-2147dd78-237f-47e5-82c9-0249dc978857 tempest-VolumesTransfersV355Test-295471338 None] Deleted volume successfully. Dec 11 21:10:35.907038 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-2147dd78-237f-47e5-82c9-0249dc978857 tempest-VolumesTransfersV355Test-295471338 None] Lock "b'cinder-812b0af1-dc10-487e-bee7-144d9c2c1ab5-delete_volume'" released by "delete_volume" :: held 0.570s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:10:40.024667 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:10:40.028029 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:10:40.028470 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:10:40.041596 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (c053e378-cb23-4081-a1bc-015a96c498ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:40.046686 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e426d8c-b362-4313-9591-22525949b8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:40.054844 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:10:40.073078 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e426d8c-b362-4313-9591-22525949b8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-816814584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aad251d9-75e3-45be-b9ca-acfd013de8de,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f83f1c02036a488189b018359c74a465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:10:40Z,use_quota=True,user_id='e294494476844b138e20c0080637f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:40.075796 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98ef1cb-2160-43c9-89c5-166f51fc31bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:40.077979 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98ef1cb-2160-43c9-89c5-166f51fc31bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:40.080424 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca380c1b-1589-42dc-8cba-ba76c5a4bc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:40.082782 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca380c1b-1589-42dc-8cba-ba76c5a4bc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aad251d9-75e3-45be-b9ca-acfd013de8de', 'volume_name': 'volume-aad251d9-75e3-45be-b9ca-acfd013de8de', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:40.085639 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbac0ea-f44e-4ec3-adba-c7257cd88db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:40.088091 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbac0ea-f44e-4ec3-adba-c7257cd88db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:40.090677 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e85b45-ea1b-4feb-82be-6b8f119e3993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:40.091490 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Volume aad251d9-75e3-45be-b9ca-acfd013de8de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aad251d9-75e3-45be-b9ca-acfd013de8de', 'volume_size': 1} Dec 11 21:10:40.091856 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] creating volume 'volume-aad251d9-75e3-45be-b9ca-acfd013de8de' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:10:40.092853 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:40.173524 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:10:40.174258 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:10:40.181331 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e85b45-ea1b-4feb-82be-6b8f119e3993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aad251d9-75e3-45be-b9ca-acfd013de8de', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:40.185021 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6924658e-fa1d-4397-b04e-048a6d1a8046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:40.195411 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Volume volume-aad251d9-75e3-45be-b9ca-acfd013de8de (aad251d9-75e3-45be-b9ca-acfd013de8de): created successfully Dec 11 21:10:40.197885 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6924658e-fa1d-4397-b04e-048a6d1a8046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:40.201508 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (c053e378-cb23-4081-a1bc-015a96c498ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:40.211079 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-97e6fac6-4f23-4cc8-8c5c-d5e3869ca7a5 tempest-VolumesGetTest-1016277363 None] Created volume successfully. Dec 11 21:10:41.539678 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:10:41.542896 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:10:41.543839 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:10:41.558662 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (d56a1bb0-a85a-4543-b9f4-bba5e30b12ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:41.562357 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccd8fb5-1f4c-4950-b63f-cc469860dbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:41.569138 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:10:41.610129 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccd8fb5-1f4c-4950-b63f-cc469860dbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:10:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1584458928',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b786c6d-f629-4a63-874c-fc196308a591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83f1c02036a488189b018359c74a465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:10:42Z,use_quota=True,user_id='e294494476844b138e20c0080637f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:41.612770 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae5f92c-6d9f-4fe0-a591-6530973313ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:41.614969 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae5f92c-6d9f-4fe0-a591-6530973313ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:41.617392 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4bfd39-39d4-4add-9000-ec4d27cd5304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:41.619685 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4bfd39-39d4-4add-9000-ec4d27cd5304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b786c6d-f629-4a63-874c-fc196308a591', 'volume_name': 'volume-2b786c6d-f629-4a63-874c-fc196308a591', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:41.622027 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3e5926-ac73-460c-bb15-132720271492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:41.624176 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3e5926-ac73-460c-bb15-132720271492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:41.626400 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ea6c56-0e44-4877-9f44-5c0ff2d63921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:41.627207 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Volume 2b786c6d-f629-4a63-874c-fc196308a591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b786c6d-f629-4a63-874c-fc196308a591', 'volume_size': 1} Dec 11 21:10:41.627800 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] creating volume 'volume-2b786c6d-f629-4a63-874c-fc196308a591' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:10:41.628779 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:41.697756 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:10:41.698154 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:10:41.700878 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ea6c56-0e44-4877-9f44-5c0ff2d63921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b786c6d-f629-4a63-874c-fc196308a591', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:41.703284 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1732dd-34ac-4888-b617-c6fb9f10eefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:41.712293 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Volume volume-2b786c6d-f629-4a63-874c-fc196308a591 (2b786c6d-f629-4a63-874c-fc196308a591): created successfully Dec 11 21:10:41.714525 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1732dd-34ac-4888-b617-c6fb9f10eefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:41.718213 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (d56a1bb0-a85a-4543-b9f4-bba5e30b12ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:41.726513 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-3d7bfb08-6825-4201-947f-7dd241cbed07 tempest-VolumesGetTest-1016277363 None] Created volume successfully. Dec 11 21:10:42.658213 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-1c075841-10d1-409a-857c-7fbfb1ba38b6 tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-2b786c6d-f629-4a63-874c-fc196308a591-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:10:42.688936 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1c075841-10d1-409a-857c-7fbfb1ba38b6 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:42.728913 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1c075841-10d1-409a-857c-7fbfb1ba38b6 tempest-VolumesGetTest-1016277363 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:10:42.729338 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1c075841-10d1-409a-857c-7fbfb1ba38b6 tempest-VolumesGetTest-1016277363 None] Volume volume-2b786c6d-f629-4a63-874c-fc196308a591 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:10:42.734671 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1c075841-10d1-409a-857c-7fbfb1ba38b6 tempest-VolumesGetTest-1016277363 None] deleting rbd volume volume-2b786c6d-f629-4a63-874c-fc196308a591 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:10:42.987675 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-1c075841-10d1-409a-857c-7fbfb1ba38b6 tempest-VolumesGetTest-1016277363 None] Created reservations ['a262d449-0d26-4395-9d05-1692a1e58ba9', 'ebd5cab0-6e29-4b0f-979d-45cfaec80c39', '61f4d825-556b-42ee-98f5-4b9c6b13c767', '90194b20-0748-4905-a61e-468387f26ee8'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:10:43.031920 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1c075841-10d1-409a-857c-7fbfb1ba38b6 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:43.065250 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1c075841-10d1-409a-857c-7fbfb1ba38b6 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:43.097960 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-1c075841-10d1-409a-857c-7fbfb1ba38b6 tempest-VolumesGetTest-1016277363 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:10:43.102232 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1c075841-10d1-409a-857c-7fbfb1ba38b6 tempest-VolumesGetTest-1016277363 None] Deleted volume successfully. Dec 11 21:10:43.115559 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-1c075841-10d1-409a-857c-7fbfb1ba38b6 tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-2b786c6d-f629-4a63-874c-fc196308a591-delete_volume'" released by "delete_volume" :: held 0.457s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:10:43.802847 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-21d229fd-1a34-464d-8a7b-cd8e895b25c8 tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-aad251d9-75e3-45be-b9ca-acfd013de8de-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:10:43.849062 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21d229fd-1a34-464d-8a7b-cd8e895b25c8 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:43.892684 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21d229fd-1a34-464d-8a7b-cd8e895b25c8 tempest-VolumesGetTest-1016277363 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:10:43.893368 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21d229fd-1a34-464d-8a7b-cd8e895b25c8 tempest-VolumesGetTest-1016277363 None] Volume volume-aad251d9-75e3-45be-b9ca-acfd013de8de is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:10:43.898073 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21d229fd-1a34-464d-8a7b-cd8e895b25c8 tempest-VolumesGetTest-1016277363 None] deleting rbd volume volume-aad251d9-75e3-45be-b9ca-acfd013de8de {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:10:44.155937 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-21d229fd-1a34-464d-8a7b-cd8e895b25c8 tempest-VolumesGetTest-1016277363 None] Created reservations ['b126a50b-c30e-41c2-8aa6-1b2052e4cc4e', '6ad5112c-679a-4e93-82a9-9f63c434ec21', '0fd60bdf-9249-43b2-9b29-388523832cae', '1a4abc47-e247-40b6-8c7c-78c5a0fa68dd'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:10:44.198773 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21d229fd-1a34-464d-8a7b-cd8e895b25c8 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:44.225666 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21d229fd-1a34-464d-8a7b-cd8e895b25c8 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:44.257653 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-21d229fd-1a34-464d-8a7b-cd8e895b25c8 tempest-VolumesGetTest-1016277363 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:10:44.263465 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-21d229fd-1a34-464d-8a7b-cd8e895b25c8 tempest-VolumesGetTest-1016277363 None] Deleted volume successfully. Dec 11 21:10:44.275402 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-21d229fd-1a34-464d-8a7b-cd8e895b25c8 tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-aad251d9-75e3-45be-b9ca-acfd013de8de-delete_volume'" released by "delete_volume" :: held 0.473s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:10:45.187663 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:10:45.192892 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:10:45.193347 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:10:45.209807 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (057b585e-0960-4e0b-a71a-7e54616a9cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:45.213453 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ada507-de33-46d2-9dfc-0fc4479eaf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:45.219836 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:10:45.232744 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ada507-de33-46d2-9dfc-0fc4479eaf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-159049812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fc699323-3917-4d3c-b132-a2862f4abb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83f1c02036a488189b018359c74a465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:10:45Z,use_quota=True,user_id='e294494476844b138e20c0080637f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:45.235440 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8cf2db-8fa3-4659-b142-38c8db7925e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:45.237600 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8cf2db-8fa3-4659-b142-38c8db7925e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:45.240070 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63981d00-6a28-41bb-9a84-b8cc2fe0376d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:45.242374 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63981d00-6a28-41bb-9a84-b8cc2fe0376d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc699323-3917-4d3c-b132-a2862f4abb24', 'volume_name': 'volume-fc699323-3917-4d3c-b132-a2862f4abb24', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:45.244880 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9248fb-ff52-40c2-8c8a-a423b7b7f3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:45.248021 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9248fb-ff52-40c2-8c8a-a423b7b7f3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:45.250666 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d60e39-2dcc-4343-bfff-2b4647b1c94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:45.251489 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Volume fc699323-3917-4d3c-b132-a2862f4abb24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc699323-3917-4d3c-b132-a2862f4abb24', 'volume_size': 1} Dec 11 21:10:45.251881 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] creating volume 'volume-fc699323-3917-4d3c-b132-a2862f4abb24' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:10:45.253109 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:45.328557 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:10:45.329188 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:10:45.331798 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d60e39-2dcc-4343-bfff-2b4647b1c94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc699323-3917-4d3c-b132-a2862f4abb24', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:45.334229 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59323927-c3ae-4d72-9277-90226397614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:45.345319 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Volume volume-fc699323-3917-4d3c-b132-a2862f4abb24 (fc699323-3917-4d3c-b132-a2862f4abb24): created successfully Dec 11 21:10:45.347921 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59323927-c3ae-4d72-9277-90226397614a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:45.351098 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (057b585e-0960-4e0b-a71a-7e54616a9cb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:45.359511 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-99fd7408-b506-4786-b758-a89b6fb56d6b tempest-VolumesGetTest-1016277363 None] Created volume successfully. Dec 11 21:10:46.598127 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:10:46.601904 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:10:46.602357 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:10:46.625274 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (40ec8192-a586-41e3-8deb-9b8fd31fde96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:46.628565 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c3b6ba-8ae3-44b9-a79b-9a259c6e6337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:46.635138 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:10:46.651063 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c3b6ba-8ae3-44b9-a79b-9a259c6e6337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1505142382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b63ea72f-6e49-413d-9030-ec1d8334f541,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f83f1c02036a488189b018359c74a465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fc699323-3917-4d3c-b132-a2862f4abb24,status='creating',terminated_at=None,updated_at=2021-12-11T21:10:47Z,use_quota=True,user_id='e294494476844b138e20c0080637f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:46.653785 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f50b41c-46a6-414f-b36f-dbac76b6537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:46.656088 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f50b41c-46a6-414f-b36f-dbac76b6537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:46.658590 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea52065c-8d6f-49e9-a797-e82a76f41913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:46.672885 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea52065c-8d6f-49e9-a797-e82a76f41913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b63ea72f-6e49-413d-9030-ec1d8334f541', 'volume_name': 'volume-b63ea72f-6e49-413d-9030-ec1d8334f541', 'volume_size': 1, 'source_volid': 'fc699323-3917-4d3c-b132-a2862f4abb24', 'source_volstatus': 'available'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:46.676015 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a8f86b6-4042-4109-9194-d76c619bcdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:46.678195 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a8f86b6-4042-4109-9194-d76c619bcdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:46.680499 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e96f403-9940-48c3-a8b8-a773c78667e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:46.681324 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Volume b63ea72f-6e49-413d-9030-ec1d8334f541: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b63ea72f-6e49-413d-9030-ec1d8334f541', 'volume_size': 1, 'source_volid': 'fc699323-3917-4d3c-b132-a2862f4abb24', 'source_volstatus': 'available'} Dec 11 21:10:46.693970 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:46.735255 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] creating snapshot='volume-b63ea72f-6e49-413d-9030-ec1d8334f541.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:10:47.591322 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] cloning 'volume-fc699323-3917-4d3c-b132-a2862f4abb24@volume-b63ea72f-6e49-413d-9030-ec1d8334f541.clone_snap' to 'volume-b63ea72f-6e49-413d-9030-ec1d8334f541' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:10:47.683815 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Volume volume-fc699323-3917-4d3c-b132-a2862f4abb24 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:10:47.685010 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:10:47.685408 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:10:47.706081 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:10:47.708327 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e96f403-9940-48c3-a8b8-a773c78667e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63ea72f-6e49-413d-9030-ec1d8334f541', 'volume_size': 1, 'source_volid': 'fc699323-3917-4d3c-b132-a2862f4abb24', 'source_volstatus': 'available'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:47.710745 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db07f1d-9c21-40fb-aa03-18580d06d74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:47.721416 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Volume volume-b63ea72f-6e49-413d-9030-ec1d8334f541 (b63ea72f-6e49-413d-9030-ec1d8334f541): created successfully Dec 11 21:10:47.723580 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db07f1d-9c21-40fb-aa03-18580d06d74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:47.726587 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (40ec8192-a586-41e3-8deb-9b8fd31fde96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:47.740185 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c7ffaa67-3818-4acd-ace4-e6b6368bc5e4 tempest-VolumesGetTest-1016277363 None] Created volume successfully. Dec 11 21:10:49.119431 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:10:49.122767 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:10:49.123221 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:10:49.135039 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (ec6fd2a1-6fb2-4ad6-8fcb-c477bcb43b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:49.138753 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2141ed1-47b7-4928-bd61-87f65373e50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:49.145611 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:10:49.159340 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2141ed1-47b7-4928-bd61-87f65373e50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:10:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-700670934',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=36906ec8-dd71-440e-b668-e734e7a42b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83f1c02036a488189b018359c74a465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:10:49Z,use_quota=True,user_id='e294494476844b138e20c0080637f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:49.161926 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd0c2c9-a0c8-4edc-8ee9-4afc82c30a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:49.164128 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd0c2c9-a0c8-4edc-8ee9-4afc82c30a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:49.166546 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8f0845-ed9b-4c6d-9ea1-f95c453872a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:49.168821 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8f0845-ed9b-4c6d-9ea1-f95c453872a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36906ec8-dd71-440e-b668-e734e7a42b6d', 'volume_name': 'volume-36906ec8-dd71-440e-b668-e734e7a42b6d', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:49.171170 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203157c1-3a11-4ab6-8654-68eca8aa550d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:49.173896 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203157c1-3a11-4ab6-8654-68eca8aa550d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:49.176173 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4574e3b-e213-4c05-a0f9-c67c8de75cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:49.176963 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Volume 36906ec8-dd71-440e-b668-e734e7a42b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36906ec8-dd71-440e-b668-e734e7a42b6d', 'volume_size': 1} Dec 11 21:10:49.177353 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] creating volume 'volume-36906ec8-dd71-440e-b668-e734e7a42b6d' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:10:49.178308 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:49.234877 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:10:49.235358 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:10:49.237551 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4574e3b-e213-4c05-a0f9-c67c8de75cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36906ec8-dd71-440e-b668-e734e7a42b6d', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:49.239957 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4982d8a2-cb21-43df-9b9c-0d8a0f51bfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:49.248640 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Volume volume-36906ec8-dd71-440e-b668-e734e7a42b6d (36906ec8-dd71-440e-b668-e734e7a42b6d): created successfully Dec 11 21:10:49.250819 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4982d8a2-cb21-43df-9b9c-0d8a0f51bfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:49.253858 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (ec6fd2a1-6fb2-4ad6-8fcb-c477bcb43b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:49.264631 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1705a268-9a3a-4917-8df5-2b7c9d58f2c1 tempest-VolumesGetTest-1016277363 None] Created volume successfully. Dec 11 21:10:50.297622 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-6778cb0f-a859-4157-b8af-abe303d5dc30 tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-36906ec8-dd71-440e-b668-e734e7a42b6d-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:10:50.336109 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6778cb0f-a859-4157-b8af-abe303d5dc30 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:50.377394 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6778cb0f-a859-4157-b8af-abe303d5dc30 tempest-VolumesGetTest-1016277363 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:10:50.377921 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6778cb0f-a859-4157-b8af-abe303d5dc30 tempest-VolumesGetTest-1016277363 None] Volume volume-36906ec8-dd71-440e-b668-e734e7a42b6d is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:10:50.383207 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6778cb0f-a859-4157-b8af-abe303d5dc30 tempest-VolumesGetTest-1016277363 None] deleting rbd volume volume-36906ec8-dd71-440e-b668-e734e7a42b6d {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:10:50.651860 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-6778cb0f-a859-4157-b8af-abe303d5dc30 tempest-VolumesGetTest-1016277363 None] Created reservations ['889a5a2a-5994-47e5-8a6e-a2b299f8f36b', '7446e5db-521f-48cd-94e5-fa2fcc3699a2', '1ea8a5de-30fe-452f-a878-6d5d62bf8252', 'cccdbde5-6a08-420c-9856-a7d25df06847'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:10:50.692915 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6778cb0f-a859-4157-b8af-abe303d5dc30 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:50.718298 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6778cb0f-a859-4157-b8af-abe303d5dc30 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:50.742675 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-6778cb0f-a859-4157-b8af-abe303d5dc30 tempest-VolumesGetTest-1016277363 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:10:50.748985 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-6778cb0f-a859-4157-b8af-abe303d5dc30 tempest-VolumesGetTest-1016277363 None] Deleted volume successfully. Dec 11 21:10:50.762792 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-6778cb0f-a859-4157-b8af-abe303d5dc30 tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-36906ec8-dd71-440e-b668-e734e7a42b6d-delete_volume'" released by "delete_volume" :: held 0.465s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:10:51.420434 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-b63ea72f-6e49-413d-9030-ec1d8334f541-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:10:51.466222 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:51.526661 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:10:51.534394 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] deleting rbd volume volume-b63ea72f-6e49-413d-9030-ec1d8334f541 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:10:51.733384 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:10:51.754744 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] Volume volume-fc699323-3917-4d3c-b132-a2862f4abb24 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:10:51.755308 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] deleting parent snapshot volume-b63ea72f-6e49-413d-9030-ec1d8334f541.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:10:52.655659 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] Created reservations ['85daa63d-ea04-464f-9b03-93aec212ceec', '0c6fc126-bfef-472e-afcb-665b85680b7d', '40d1f9d7-3add-48f2-9030-3a001d6b0ca1', '7210f78b-40b6-4400-9562-7513bc30d160'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:10:52.730445 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:52.759759 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:52.785847 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:10:52.791275 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] Deleted volume successfully. Dec 11 21:10:52.806571 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-349e0a5a-285b-4f29-8847-14f9c32efa20 tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-b63ea72f-6e49-413d-9030-ec1d8334f541-delete_volume'" released by "delete_volume" :: held 1.386s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:10:54.011772 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:10:54.015160 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:10:54.015600 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:10:54.028323 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (21f711b9-8f26-4e63-855c-3223a7933756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:54.031617 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63cb9ec-b66c-477f-821d-3a78a56acb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:54.037799 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:10:54.053258 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63cb9ec-b66c-477f-821d-3a78a56acb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1835921869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=25f6a191-14f9-4501-a950-6f905b5b1ea5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f83f1c02036a488189b018359c74a465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:10:54Z,use_quota=True,user_id='e294494476844b138e20c0080637f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:54.056249 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a76f6b-509f-4b3e-9a09-9ae290eff440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:54.058725 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a76f6b-509f-4b3e-9a09-9ae290eff440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:54.061278 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53167547-bb35-4f9a-bf02-ba3c56ab5398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:54.147187 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53167547-bb35-4f9a-bf02-ba3c56ab5398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25f6a191-14f9-4501-a950-6f905b5b1ea5', 'volume_name': 'volume-25f6a191-14f9-4501-a950-6f905b5b1ea5', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:54.150306 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef5b2e7-1501-4477-bdf4-77aa2b416d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:54.154178 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef5b2e7-1501-4477-bdf4-77aa2b416d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:54.156756 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f0adfa-f384-44ff-81c1-7502ed1b5747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:54.157586 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Volume 25f6a191-14f9-4501-a950-6f905b5b1ea5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25f6a191-14f9-4501-a950-6f905b5b1ea5', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 21:10:54.158255 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Cloning 25f6a191-14f9-4501-a950-6f905b5b1ea5 from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 21:10:54.166680 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:10:54.176583 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 10, 54, 172315)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:10:54.176983 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:10:54.177421 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 21:10:54.181737 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:10:54.182583 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 21:10:54.187970 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 10, 54, 185818)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:10:54.188380 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:10:54.188764 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 21:10:54.200585 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:54.254587 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] creating snapshot='volume-25f6a191-14f9-4501-a950-6f905b5b1ea5.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:10:54.622274 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-25f6a191-14f9-4501-a950-6f905b5b1ea5.clone_snap' to 'volume-25f6a191-14f9-4501-a950-6f905b5b1ea5' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:10:54.750290 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:10:54.751552 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:10:54.751930 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:10:54.777347 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:10:54.777946 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Marking volume 25f6a191-14f9-4501-a950-6f905b5b1ea5 as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:10:54.785990 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to 25f6a191-14f9-4501-a950-6f905b5b1ea5. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 21:10:54.786895 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Creating volume glance metadata for volume 25f6a191-14f9-4501-a950-6f905b5b1ea5 backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 21:10:54.851353 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f0adfa-f384-44ff-81c1-7502ed1b5747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f6a191-14f9-4501-a950-6f905b5b1ea5', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:54.854676 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3619e42-eda4-47f7-8111-b379461b06b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:54.863622 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Volume volume-25f6a191-14f9-4501-a950-6f905b5b1ea5 (25f6a191-14f9-4501-a950-6f905b5b1ea5): created successfully Dec 11 21:10:54.865909 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3619e42-eda4-47f7-8111-b379461b06b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:54.869733 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (21f711b9-8f26-4e63-855c-3223a7933756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:54.877815 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-56914b74-f0eb-4771-9a38-4c103d963e51 tempest-VolumesGetTest-1016277363 None] Created volume successfully. Dec 11 21:10:55.507849 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:10:55.511943 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:10:55.512381 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:10:55.524345 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (a376b9fe-c216-42a9-9542-00f153a6fbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:55.528430 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb88dd4-e9b4-4ddb-aa0c-b2eafcc6e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:55.534627 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:10:55.547423 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb88dd4-e9b4-4ddb-aa0c-b2eafcc6e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:10:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1399337310',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=57e75a06-814f-4ce7-8721-1f44446cbdb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83f1c02036a488189b018359c74a465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:10:55Z,use_quota=True,user_id='e294494476844b138e20c0080637f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:55.550030 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b819a517-ee05-4b57-9296-07056d514ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:55.552274 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b819a517-ee05-4b57-9296-07056d514ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:55.554735 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd0aa04-7df8-4c79-9a8d-ecee5f396d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:55.557104 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd0aa04-7df8-4c79-9a8d-ecee5f396d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e75a06-814f-4ce7-8721-1f44446cbdb5', 'volume_name': 'volume-57e75a06-814f-4ce7-8721-1f44446cbdb5', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:55.559518 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded9dc14-104e-4f37-a8d5-86a99cbd6f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:55.561655 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded9dc14-104e-4f37-a8d5-86a99cbd6f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:55.563923 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5f10a5-bc91-421a-a656-3c075e5dc362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:55.564723 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Volume 57e75a06-814f-4ce7-8721-1f44446cbdb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e75a06-814f-4ce7-8721-1f44446cbdb5', 'volume_size': 1} Dec 11 21:10:55.565103 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] creating volume 'volume-57e75a06-814f-4ce7-8721-1f44446cbdb5' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:10:55.566068 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:55.628104 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:10:55.628576 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:10:55.630750 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5f10a5-bc91-421a-a656-3c075e5dc362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e75a06-814f-4ce7-8721-1f44446cbdb5', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:55.633045 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34d186e-a776-412e-aaaf-0504bba4a9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:10:55.641769 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Volume volume-57e75a06-814f-4ce7-8721-1f44446cbdb5 (57e75a06-814f-4ce7-8721-1f44446cbdb5): created successfully Dec 11 21:10:55.643930 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34d186e-a776-412e-aaaf-0504bba4a9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:10:55.646997 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Flow 'volume_create_manager' (a376b9fe-c216-42a9-9542-00f153a6fbf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:10:55.656140 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-901d97bf-9014-48c0-a2fc-ae8874bab7d7 tempest-VolumesGetTest-1016277363 None] Created volume successfully. Dec 11 21:10:55.846364 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:10:55.847463 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:55.872143 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:55.912773 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:10:56.635458 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-f5f50f3c-3ae4-47ab-ba93-485f98d8f55f tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-57e75a06-814f-4ce7-8721-1f44446cbdb5-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:10:56.675503 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5f50f3c-3ae4-47ab-ba93-485f98d8f55f tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:56.728955 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5f50f3c-3ae4-47ab-ba93-485f98d8f55f tempest-VolumesGetTest-1016277363 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:10:56.729869 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5f50f3c-3ae4-47ab-ba93-485f98d8f55f tempest-VolumesGetTest-1016277363 None] Volume volume-57e75a06-814f-4ce7-8721-1f44446cbdb5 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:10:56.738653 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5f50f3c-3ae4-47ab-ba93-485f98d8f55f tempest-VolumesGetTest-1016277363 None] deleting rbd volume volume-57e75a06-814f-4ce7-8721-1f44446cbdb5 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:10:56.999707 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-f5f50f3c-3ae4-47ab-ba93-485f98d8f55f tempest-VolumesGetTest-1016277363 None] Created reservations ['b3c30324-af31-452d-892f-02c2561fe2af', '6d390624-2de0-4e97-b820-9b7c20cefc52', '7b9cf17e-22cf-4406-addc-5a52e9197c04', 'bd9f0bed-fb72-449a-813b-26a4cf85ed94'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:10:57.058040 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5f50f3c-3ae4-47ab-ba93-485f98d8f55f tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:57.091907 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5f50f3c-3ae4-47ab-ba93-485f98d8f55f tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:57.117966 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-f5f50f3c-3ae4-47ab-ba93-485f98d8f55f tempest-VolumesGetTest-1016277363 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:10:57.122702 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f5f50f3c-3ae4-47ab-ba93-485f98d8f55f tempest-VolumesGetTest-1016277363 None] Deleted volume successfully. Dec 11 21:10:57.135566 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-f5f50f3c-3ae4-47ab-ba93-485f98d8f55f tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-57e75a06-814f-4ce7-8721-1f44446cbdb5-delete_volume'" released by "delete_volume" :: held 0.500s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:10:57.768426 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-9385f9b3-1ab6-4c71-9c84-5901a12ead08 tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-25f6a191-14f9-4501-a950-6f905b5b1ea5-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:10:57.801645 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9385f9b3-1ab6-4c71-9c84-5901a12ead08 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:57.867596 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9385f9b3-1ab6-4c71-9c84-5901a12ead08 tempest-VolumesGetTest-1016277363 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:10:57.874794 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9385f9b3-1ab6-4c71-9c84-5901a12ead08 tempest-VolumesGetTest-1016277363 None] deleting rbd volume volume-25f6a191-14f9-4501-a950-6f905b5b1ea5 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:10:58.114632 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9385f9b3-1ab6-4c71-9c84-5901a12ead08 tempest-VolumesGetTest-1016277363 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:10:58.150190 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9385f9b3-1ab6-4c71-9c84-5901a12ead08 tempest-VolumesGetTest-1016277363 None] deleting parent snapshot volume-25f6a191-14f9-4501-a950-6f905b5b1ea5.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:10:58.702786 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-9385f9b3-1ab6-4c71-9c84-5901a12ead08 tempest-VolumesGetTest-1016277363 None] Created reservations ['c4b1205d-562d-4403-807e-cb6a8915bf47', 'fff7f79c-7084-4a71-8398-aa00ad5634a9', '3dbe9c90-720b-49b5-b867-9edd2ff19c24', '05f9e00e-1107-4546-8a43-3f501d446cf6'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:10:58.741970 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9385f9b3-1ab6-4c71-9c84-5901a12ead08 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:58.767155 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9385f9b3-1ab6-4c71-9c84-5901a12ead08 tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:58.798029 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-9385f9b3-1ab6-4c71-9c84-5901a12ead08 tempest-VolumesGetTest-1016277363 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:10:58.802202 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9385f9b3-1ab6-4c71-9c84-5901a12ead08 tempest-VolumesGetTest-1016277363 None] Deleted volume successfully. Dec 11 21:10:58.815850 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-9385f9b3-1ab6-4c71-9c84-5901a12ead08 tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-25f6a191-14f9-4501-a950-6f905b5b1ea5-delete_volume'" released by "delete_volume" :: held 1.047s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:10:58.903347 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-13c43827-dc9f-4a7b-babf-f635cd865deb tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-fc699323-3917-4d3c-b132-a2862f4abb24-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:10:58.941413 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13c43827-dc9f-4a7b-babf-f635cd865deb tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:58.984769 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13c43827-dc9f-4a7b-babf-f635cd865deb tempest-VolumesGetTest-1016277363 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:10:58.985288 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13c43827-dc9f-4a7b-babf-f635cd865deb tempest-VolumesGetTest-1016277363 None] Volume volume-fc699323-3917-4d3c-b132-a2862f4abb24 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:10:58.991696 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13c43827-dc9f-4a7b-babf-f635cd865deb tempest-VolumesGetTest-1016277363 None] deleting rbd volume volume-fc699323-3917-4d3c-b132-a2862f4abb24 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:10:59.231678 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-13c43827-dc9f-4a7b-babf-f635cd865deb tempest-VolumesGetTest-1016277363 None] Created reservations ['5c6ccea3-30d4-43aa-b97c-3f34a72d076f', '28fc1e8a-450f-4030-b23d-94882e65556e', '60e0c1ff-59e1-4c45-88fb-6729e0ebc77d', '40d7ea3d-5f68-42cd-a117-0805f2f639c5'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:10:59.278098 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13c43827-dc9f-4a7b-babf-f635cd865deb tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:59.304775 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13c43827-dc9f-4a7b-babf-f635cd865deb tempest-VolumesGetTest-1016277363 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:10:59.328696 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-13c43827-dc9f-4a7b-babf-f635cd865deb tempest-VolumesGetTest-1016277363 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:10:59.332853 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-13c43827-dc9f-4a7b-babf-f635cd865deb tempest-VolumesGetTest-1016277363 None] Deleted volume successfully. Dec 11 21:10:59.346835 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-13c43827-dc9f-4a7b-babf-f635cd865deb tempest-VolumesGetTest-1016277363 None] Lock "b'cinder-fc699323-3917-4d3c-b132-a2862f4abb24-delete_volume'" released by "delete_volume" :: held 0.444s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:11:02.968894 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:11:02.972332 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:11:02.972773 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:11:02.985423 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Flow 'volume_create_manager' (ef1d2153-e2b4-4ef2-9419-2a2f89c583c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:11:02.988793 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd6b6ab-cd8d-426d-a9eb-15e30ef42650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:02.996189 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:11:03.008888 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd6b6ab-cd8d-426d-a9eb-15e30ef42650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-923551107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a5ad3712-ba49-4336-9ea6-4de8b933fc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4720aeed7bbd42e2aa8790c9c63b0d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:11:03Z,use_quota=True,user_id='88d74179d55a4b4193ac3f2a473677c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:03.012090 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ac9152-4674-4d10-92ce-166582138537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:03.014274 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ac9152-4674-4d10-92ce-166582138537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:03.016730 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844588f8-c8a6-45c0-8541-604792a0c160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:03.019026 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844588f8-c8a6-45c0-8541-604792a0c160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5ad3712-ba49-4336-9ea6-4de8b933fc6f', 'volume_name': 'volume-a5ad3712-ba49-4336-9ea6-4de8b933fc6f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:03.021353 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fcdcd9-a29b-4443-b2ed-8bf78c87afe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:03.023597 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fcdcd9-a29b-4443-b2ed-8bf78c87afe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:03.025829 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073ec50b-ef73-4efd-8838-4464e100cc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:03.026639 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Volume a5ad3712-ba49-4336-9ea6-4de8b933fc6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5ad3712-ba49-4336-9ea6-4de8b933fc6f', 'volume_size': 1} Dec 11 21:11:03.027072 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] creating volume 'volume-a5ad3712-ba49-4336-9ea6-4de8b933fc6f' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:11:03.028044 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:03.082450 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:11:03.082859 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:11:03.084972 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073ec50b-ef73-4efd-8838-4464e100cc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5ad3712-ba49-4336-9ea6-4de8b933fc6f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:03.087290 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8679dcd8-a15d-4358-bb5d-3839755dbca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:03.095486 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Volume volume-a5ad3712-ba49-4336-9ea6-4de8b933fc6f (a5ad3712-ba49-4336-9ea6-4de8b933fc6f): created successfully Dec 11 21:11:03.097631 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8679dcd8-a15d-4358-bb5d-3839755dbca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:03.100683 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Flow 'volume_create_manager' (ef1d2153-e2b4-4ef2-9419-2a2f89c583c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:11:03.108276 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7e8dc404-b873-4fed-9361-d086ca273091 tempest-VolumesSnapshotTestJSON-970988873 None] Created volume successfully. Dec 11 21:11:04.154303 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9f16b59d-84e9-4653-957a-8fb30a6873dd tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:04.503915 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9f16b59d-84e9-4653-957a-8fb30a6873dd tempest-VolumesSnapshotTestJSON-970988873 None] Create snapshot completed successfully Dec 11 21:11:05.607026 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.driver [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] Creating a new backup for volume volume-a5ad3712-ba49-4336-9ea6-4de8b933fc6f. {{(pid=134173) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1226}} Dec 11 21:11:05.657162 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] cloning volumes/volume-a5ad3712-ba49-4336-9ea6-4de8b933fc6f@snapshot-0e151072-24bc-4b61-996a-553a6eb49ce8 to volume-155f9e95-a05d-4320-bbcf-50014d909d4c {{(pid=134173) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 11 21:11:05.657731 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:05.709662 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:05.865514 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:11:05.866174 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:11:05.871779 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:05.928927 ncdv-master-1 cinder-volume[134173]: WARNING cinder.volume.drivers.rbd [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues Dec 11 21:11:05.976739 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:11:06.802391 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.825s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:11:06.803224 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-155f9e95-a05d-4320-bbcf-50014d909d4c', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '155f9e95-a05d-4320-bbcf-50014d909d4c', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:11:06.818177 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] Initialize volume connection completed successfully. Dec 11 21:11:12.898789 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:11:12.903511 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:11:12.904018 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:11:12.918591 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Flow 'volume_create_manager' (9c914824-ef3a-403d-b623-b5fdc07be356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:11:12.922170 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b6d5a2-3187-4ed3-aac5-9d8179c8c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:12.929265 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:11:12.943485 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b6d5a2-3187-4ed3-aac5-9d8179c8c437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-357321663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=531e4493-0fa5-4b02-b9c7-c8db7e07cc42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877d0194d21c485ab3477d5ed73d1970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:11:13Z,use_quota=True,user_id='ce37b5065dd34b50bb4eeafe95e650a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:12.946668 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d25905-13ff-4564-ae79-8cf28d3b0daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:12.949595 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d25905-13ff-4564-ae79-8cf28d3b0daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:12.952405 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bf30dc-b1dd-4605-a145-c6eda893c402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:12.955092 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bf30dc-b1dd-4605-a145-c6eda893c402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531e4493-0fa5-4b02-b9c7-c8db7e07cc42', 'volume_name': 'volume-531e4493-0fa5-4b02-b9c7-c8db7e07cc42', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:12.957564 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4254909-09ef-41ac-af75-779af4c46290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:12.960038 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4254909-09ef-41ac-af75-779af4c46290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:12.962625 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba34305-5a37-4f3d-921f-459dab1df203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:12.963470 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Volume 531e4493-0fa5-4b02-b9c7-c8db7e07cc42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531e4493-0fa5-4b02-b9c7-c8db7e07cc42', 'volume_size': 1} Dec 11 21:11:12.963884 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] creating volume 'volume-531e4493-0fa5-4b02-b9c7-c8db7e07cc42' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:11:12.965055 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:13.043367 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:11:13.043839 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:11:13.047428 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba34305-5a37-4f3d-921f-459dab1df203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531e4493-0fa5-4b02-b9c7-c8db7e07cc42', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:13.052603 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb22245-236f-4355-9f76-60d3b76cd6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:13.064620 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Volume volume-531e4493-0fa5-4b02-b9c7-c8db7e07cc42 (531e4493-0fa5-4b02-b9c7-c8db7e07cc42): created successfully Dec 11 21:11:13.067117 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb22245-236f-4355-9f76-60d3b76cd6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:13.070603 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Flow 'volume_create_manager' (9c914824-ef3a-403d-b623-b5fdc07be356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:11:13.079903 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-a66178f2-6c00-44a8-bd5f-a168e17c9f59 tempest-AttachVolumeShelveTestJSON-486918854 None] Created volume successfully. Dec 11 21:11:16.423284 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] Terminate volume connection completed successfully. Dec 11 21:11:16.441417 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] Remove volume export completed successfully. Dec 11 21:11:16.493606 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-155f9e95-a05d-4320-bbcf-50014d909d4c-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:11:16.507437 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:16.567302 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:11:16.574397 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] deleting rbd volume volume-155f9e95-a05d-4320-bbcf-50014d909d4c {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:11:16.840422 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] Deleted volume successfully. Dec 11 21:11:16.848199 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-f5ecd2a5-c97b-4af3-bc3c-8999ff9c4d2c tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-155f9e95-a05d-4320-bbcf-50014d909d4c-delete_volume'" released by "delete_volume" :: held 0.355s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:11:30.899200 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:11:30.905524 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:11:30.906112 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:11:30.919009 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Flow 'volume_create_manager' (259591cc-45dd-4a88-b541-0a771e0efade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:11:30.923755 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab24020a-8504-4479-a59b-6577a7c77d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:30.931494 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:11:30.945076 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab24020a-8504-4479-a59b-6577a7c77d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-878980719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d439c366-f8ce-44a8-806c-887821415191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4720aeed7bbd42e2aa8790c9c63b0d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:11:31Z,use_quota=True,user_id='88d74179d55a4b4193ac3f2a473677c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:30.948792 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6034421a-1df3-4282-b926-33211f87d8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:30.951239 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6034421a-1df3-4282-b926-33211f87d8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:30.953912 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6974f888-8289-4fc9-a06c-769ea47a042e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:31.066687 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6974f888-8289-4fc9-a06c-769ea47a042e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd439c366-f8ce-44a8-806c-887821415191', 'volume_name': 'volume-d439c366-f8ce-44a8-806c-887821415191', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:31.069301 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa9563f-41a9-431a-8cff-e0272c7261c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:31.071544 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa9563f-41a9-431a-8cff-e0272c7261c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:31.075269 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c59214-35aa-4c1d-910f-89d0465eb824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:31.076288 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Volume d439c366-f8ce-44a8-806c-887821415191: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d439c366-f8ce-44a8-806c-887821415191', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 21:11:31.077335 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Cloning d439c366-f8ce-44a8-806c-887821415191 from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 21:11:31.109420 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.031s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:11:31.129395 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 11, 31, 117117)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:11:31.132172 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:11:31.132689 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 21:11:31.145867 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.037s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:11:31.151815 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 21:11:31.173743 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 11, 31, 163055)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:11:31.174278 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:11:31.174798 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 21:11:31.206334 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:31.274872 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] creating snapshot='volume-d439c366-f8ce-44a8-806c-887821415191.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:11:31.668813 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-d439c366-f8ce-44a8-806c-887821415191.clone_snap' to 'volume-d439c366-f8ce-44a8-806c-887821415191' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:11:31.866695 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:11:31.868161 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:11:31.868597 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:11:31.901616 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:11:31.902301 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Marking volume d439c366-f8ce-44a8-806c-887821415191 as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:11:31.913231 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to d439c366-f8ce-44a8-806c-887821415191. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 21:11:31.913677 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Creating volume glance metadata for volume d439c366-f8ce-44a8-806c-887821415191 backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 21:11:32.005601 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c59214-35aa-4c1d-910f-89d0465eb824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d439c366-f8ce-44a8-806c-887821415191', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:32.007977 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6277287-f789-42fc-a6b1-eac11dd65d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:11:32.018126 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Volume volume-d439c366-f8ce-44a8-806c-887821415191 (d439c366-f8ce-44a8-806c-887821415191): created successfully Dec 11 21:11:32.020374 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6277287-f789-42fc-a6b1-eac11dd65d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:11:32.027215 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Flow 'volume_create_manager' (259591cc-45dd-4a88-b541-0a771e0efade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:11:32.035719 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-18b96346-5e23-44f6-9a2f-23e0ff2f94bb tempest-VolumesSnapshotTestJSON-970988873 None] Created volume successfully. Dec 11 21:11:33.374194 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-108989ac-c1c6-4ded-9890-72021e642a22 req-9df161c8-ac0f-4619-91d6-45188c5ae776 tempest-VolumesSnapshotTestJSON-970988873 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:11:34.205366 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-108989ac-c1c6-4ded-9890-72021e642a22 req-9df161c8-ac0f-4619-91d6-45188c5ae776 tempest-VolumesSnapshotTestJSON-970988873 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.831s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:11:34.206419 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-108989ac-c1c6-4ded-9890-72021e642a22 req-9df161c8-ac0f-4619-91d6-45188c5ae776 tempest-VolumesSnapshotTestJSON-970988873 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d439c366-f8ce-44a8-806c-887821415191', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'd439c366-f8ce-44a8-806c-887821415191', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:11:34.279391 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-108989ac-c1c6-4ded-9890-72021e642a22 req-9df161c8-ac0f-4619-91d6-45188c5ae776 tempest-VolumesSnapshotTestJSON-970988873 None] Connection info returned from driver {'name': 'volumes/volume-d439c366-f8ce-44a8-806c-887821415191', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd439c366-f8ce-44a8-806c-887821415191', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd7ed6036-e0b9-4da9-bec4-d4025f9b54a3'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:11:34.377089 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-108989ac-c1c6-4ded-9890-72021e642a22 req-9df161c8-ac0f-4619-91d6-45188c5ae776 tempest-VolumesSnapshotTestJSON-970988873 None] attachment_update completed successfully. Dec 11 21:11:36.862246 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d4d1573b-e573-4d8d-be74-31bc23c68f18 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:37.868334 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d4d1573b-e573-4d8d-be74-31bc23c68f18 tempest-VolumesSnapshotTestJSON-970988873 None] Create snapshot completed successfully Dec 11 21:11:39.240015 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-041dde55-0334-4c91-95c1-95b8cbf21143 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:39.993130 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-041dde55-0334-4c91-95c1-95b8cbf21143 tempest-VolumesSnapshotTestJSON-970988873 None] Create snapshot completed successfully Dec 11 21:11:40.629377 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b240f775-6153-442f-9ac7-9e941a2025aa tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:41.934995 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b240f775-6153-442f-9ac7-9e941a2025aa tempest-VolumesSnapshotTestJSON-970988873 None] Create snapshot completed successfully Dec 11 21:11:42.692033 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-65bfb01e-6b17-46a6-aa9c-66f8c5207941 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-0d7761d7-298c-4b58-99ef-9fd1cf44b7a7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:11:42.693967 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-65bfb01e-6b17-46a6-aa9c-66f8c5207941 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:47.700707 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-63b2bb04-5b42-459b-bff9-1c0f5c290d07 req-fb278ee2-d429-438a-aed2-3d39cfdd23d9 tempest-AttachVolumeShelveTestJSON-486918854 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:11:48.421913 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-63b2bb04-5b42-459b-bff9-1c0f5c290d07 req-fb278ee2-d429-438a-aed2-3d39cfdd23d9 tempest-AttachVolumeShelveTestJSON-486918854 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.721s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:11:48.423470 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-63b2bb04-5b42-459b-bff9-1c0f5c290d07 req-fb278ee2-d429-438a-aed2-3d39cfdd23d9 tempest-AttachVolumeShelveTestJSON-486918854 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-531e4493-0fa5-4b02-b9c7-c8db7e07cc42', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '531e4493-0fa5-4b02-b9c7-c8db7e07cc42', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:11:48.448805 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-63b2bb04-5b42-459b-bff9-1c0f5c290d07 req-fb278ee2-d429-438a-aed2-3d39cfdd23d9 tempest-AttachVolumeShelveTestJSON-486918854 None] Connection info returned from driver {'name': 'volumes/volume-531e4493-0fa5-4b02-b9c7-c8db7e07cc42', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '531e4493-0fa5-4b02-b9c7-c8db7e07cc42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ccc2ceb0-3e3f-4a89-bc48-f4393478c5e1'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:11:48.530264 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-63b2bb04-5b42-459b-bff9-1c0f5c290d07 req-fb278ee2-d429-438a-aed2-3d39cfdd23d9 tempest-AttachVolumeShelveTestJSON-486918854 None] attachment_update completed successfully. Dec 11 21:11:55.848480 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:11:55.849558 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:55.935722 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:11:56.022658 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:12:12.919453 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-65bfb01e-6b17-46a6-aa9c-66f8c5207941 tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['49f4f2b7-107a-4117-b44e-e2e2ef9563b5', '32dc2390-01c4-4498-b84d-0e8aa4810d22', '6bd9a66c-4d4a-4b4d-9ca3-c6079b4d713e', 'a7340e99-d24a-4c5d-805f-df420d418e29'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:12:12.980456 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-65bfb01e-6b17-46a6-aa9c-66f8c5207941 tempest-VolumesSnapshotTestJSON-970988873 None] Delete snapshot completed successfully. Dec 11 21:12:12.990177 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-65bfb01e-6b17-46a6-aa9c-66f8c5207941 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-0d7761d7-298c-4b58-99ef-9fd1cf44b7a7-delete_snapshot'" released by "delete_snapshot" :: held 30.298s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:12:13.972726 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c365e663-f3b5-4b8b-89a0-f83d7a985965 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-ea7b56f5-f284-4419-8122-c1f494936ac1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:12:13.975815 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c365e663-f3b5-4b8b-89a0-f83d7a985965 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:12:44.193741 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-c365e663-f3b5-4b8b-89a0-f83d7a985965 tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['5695dc1c-0818-435c-a172-11a89f840342', 'd83cf896-6116-4403-bf15-f4e8991ab536', '6e8924a2-22f9-495c-a52d-326804d03250', 'da479027-e7ff-465c-8fc9-a2bd9a8d13ba'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:12:44.238994 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c365e663-f3b5-4b8b-89a0-f83d7a985965 tempest-VolumesSnapshotTestJSON-970988873 None] Delete snapshot completed successfully. Dec 11 21:12:44.244993 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c365e663-f3b5-4b8b-89a0-f83d7a985965 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-ea7b56f5-f284-4419-8122-c1f494936ac1-delete_snapshot'" released by "delete_snapshot" :: held 30.273s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:12:45.138687 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-5d3e5c43-48f6-4ecc-bdb0-2f2542b1196c tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-044f28ca-39ea-4289-9d70-d4f6a43809e3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:12:45.140826 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5d3e5c43-48f6-4ecc-bdb0-2f2542b1196c tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:12:55.850872 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:12:55.851630 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:12:55.876626 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:12:55.905501 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:13:15.337193 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-5d3e5c43-48f6-4ecc-bdb0-2f2542b1196c tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['4725bb32-d2d4-4133-a5e0-58b9098b0b4b', 'bc6dcd81-a5c9-4733-b8c6-fe4b777b846f', '3590cd86-4897-4cc4-9d9f-44f218c03c11', '6b76d760-e026-4d14-acdb-cabe3b76c62a'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:13:15.420183 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-5d3e5c43-48f6-4ecc-bdb0-2f2542b1196c tempest-VolumesSnapshotTestJSON-970988873 None] Delete snapshot completed successfully. Dec 11 21:13:15.428800 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-5d3e5c43-48f6-4ecc-bdb0-2f2542b1196c tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-044f28ca-39ea-4289-9d70-d4f6a43809e3-delete_snapshot'" released by "delete_snapshot" :: held 30.290s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:13:17.088954 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-69d7329a-8175-4d4d-a304-04dd08a22bd3 req-2d7dfe2f-7771-4a21-ba6b-4679e06105df tempest-VolumesSnapshotTestJSON-970988873 None] Terminate volume connection completed successfully. Dec 11 21:13:17.089634 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-69d7329a-8175-4d4d-a304-04dd08a22bd3 req-2d7dfe2f-7771-4a21-ba6b-4679e06105df tempest-VolumesSnapshotTestJSON-970988873 None] Deleting attachment d7ed6036-e0b9-4da9-bec4-d4025f9b54a3. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:13:22.149594 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1ff76983-befb-44b1-b618-78ef30fdd05c tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:13:23.057054 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1ff76983-befb-44b1-b618-78ef30fdd05c tempest-VolumesSnapshotTestJSON-970988873 None] Create snapshot completed successfully Dec 11 21:13:23.381536 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-308e301e-c295-454a-a753-80cea85a6531 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-a55aa774-7db9-490e-91c1-2f2681e91c4d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:13:23.386256 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-308e301e-c295-454a-a753-80cea85a6531 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:13:24.111851 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-308e301e-c295-454a-a753-80cea85a6531 tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['7b07d95c-801b-4d44-811c-f8ebf066299a', '5999cf46-1b61-41b9-82ac-795d664541a5', '37fc12bf-c0f3-44c8-8176-a5b8db35b264', '40cf88f3-592d-4d7d-8638-a2e7dc593277'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:13:24.206096 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-308e301e-c295-454a-a753-80cea85a6531 tempest-VolumesSnapshotTestJSON-970988873 None] Delete snapshot completed successfully. Dec 11 21:13:24.217190 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-308e301e-c295-454a-a753-80cea85a6531 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-a55aa774-7db9-490e-91c1-2f2681e91c4d-delete_snapshot'" released by "delete_snapshot" :: held 0.837s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:13:24.638456 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-d03d59e8-b70e-4750-ba2e-d08276d62469 req-c551609f-1e6f-4134-9e5c-06229fc8112f tempest-AttachVolumeShelveTestJSON-486918854 None] Terminate volume connection completed successfully. Dec 11 21:13:24.639061 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-d03d59e8-b70e-4750-ba2e-d08276d62469 req-c551609f-1e6f-4134-9e5c-06229fc8112f tempest-AttachVolumeShelveTestJSON-486918854 None] Deleting attachment ccc2ceb0-3e3f-4a89-bc48-f4393478c5e1. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:13:24.873870 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6d8b4618-eee6-4e52-9203-36761f9dd74d tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:13:26.114061 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-6d8b4618-eee6-4e52-9203-36761f9dd74d tempest-VolumesSnapshotTestJSON-970988873 None] Create snapshot completed successfully Dec 11 21:13:46.332350 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-40dab908-4b74-493e-a440-6b99ca426d9e req-3b9281d7-6bb1-4278-a880-e4a05e97ab85 tempest-VolumesSnapshotTestJSON-970988873 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:13:47.225823 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-40dab908-4b74-493e-a440-6b99ca426d9e req-3b9281d7-6bb1-4278-a880-e4a05e97ab85 tempest-VolumesSnapshotTestJSON-970988873 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.894s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:13:47.226637 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-40dab908-4b74-493e-a440-6b99ca426d9e req-3b9281d7-6bb1-4278-a880-e4a05e97ab85 tempest-VolumesSnapshotTestJSON-970988873 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a5ad3712-ba49-4336-9ea6-4de8b933fc6f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'a5ad3712-ba49-4336-9ea6-4de8b933fc6f', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:13:47.311908 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-40dab908-4b74-493e-a440-6b99ca426d9e req-3b9281d7-6bb1-4278-a880-e4a05e97ab85 tempest-VolumesSnapshotTestJSON-970988873 None] Connection info returned from driver {'name': 'volumes/volume-a5ad3712-ba49-4336-9ea6-4de8b933fc6f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a5ad3712-ba49-4336-9ea6-4de8b933fc6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1e291f8b-9890-42ab-b883-9b2ec835f679'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:13:47.416136 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-40dab908-4b74-493e-a440-6b99ca426d9e req-3b9281d7-6bb1-4278-a880-e4a05e97ab85 tempest-VolumesSnapshotTestJSON-970988873 None] attachment_update completed successfully. Dec 11 21:13:49.793946 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ec8fdeaa-3dd7-4f47-9ae7-54167fadbde8 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:13:51.036663 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ec8fdeaa-3dd7-4f47-9ae7-54167fadbde8 tempest-VolumesSnapshotTestJSON-970988873 None] Create snapshot completed successfully Dec 11 21:13:52.231090 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-12ffe3df-22ca-430b-b49e-95ae1bcb7f83 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:13:53.008594 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-12ffe3df-22ca-430b-b49e-95ae1bcb7f83 tempest-VolumesSnapshotTestJSON-970988873 None] Create snapshot completed successfully Dec 11 21:13:53.337415 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-cfc3f9d6-4ba8-44c7-a9c0-5f10dab9f861 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-2d5268c5-51d9-4aca-9844-5ba307633a02-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.028s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:13:53.338935 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-cfc3f9d6-4ba8-44c7-a9c0-5f10dab9f861 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:13:55.851739 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:13:55.853261 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:13:55.908838 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:13:55.979988 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:14:17.168506 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:14:17.172382 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:14:17.172966 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:14:17.187276 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Flow 'volume_create_manager' (140372b7-db4d-4e95-89c4-0ce41228a6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:14:17.190570 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556693cc-9cee-45a2-83b6-9466dc0f899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:17.197528 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:14:17.210413 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556693cc-9cee-45a2-83b6-9466dc0f899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-528376904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=973376c4-c2de-491a-8c04-190c2ffd5bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73479623e5e0477a9ee05e0404dd87ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:14:17Z,use_quota=True,user_id='00bb98cfa8a24921a0fd211e23b2c572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:17.213112 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa5f9d1-0305-4ec1-9577-8360e5aaf809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:17.215301 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa5f9d1-0305-4ec1-9577-8360e5aaf809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:17.217713 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68810732-4af3-4da7-ad44-19bfa8f2e0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:17.219992 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68810732-4af3-4da7-ad44-19bfa8f2e0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '973376c4-c2de-491a-8c04-190c2ffd5bac', 'volume_name': 'volume-973376c4-c2de-491a-8c04-190c2ffd5bac', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:17.222830 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98baa8ff-1c0c-49b6-b662-68944ec78ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:17.224955 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98baa8ff-1c0c-49b6-b662-68944ec78ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:17.227202 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b388d9-19b4-46e8-8ac7-282f78792aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:17.227973 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Volume 973376c4-c2de-491a-8c04-190c2ffd5bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-973376c4-c2de-491a-8c04-190c2ffd5bac', 'volume_size': 1} Dec 11 21:14:17.228365 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] creating volume 'volume-973376c4-c2de-491a-8c04-190c2ffd5bac' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:14:17.229326 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:17.290132 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:14:17.290691 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:14:17.292866 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b388d9-19b4-46e8-8ac7-282f78792aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-973376c4-c2de-491a-8c04-190c2ffd5bac', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:17.295414 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e3a982-4ae8-4201-b0c6-d86556d05e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:17.304915 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Volume volume-973376c4-c2de-491a-8c04-190c2ffd5bac (973376c4-c2de-491a-8c04-190c2ffd5bac): created successfully Dec 11 21:14:17.306909 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e3a982-4ae8-4201-b0c6-d86556d05e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:17.309893 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Flow 'volume_create_manager' (140372b7-db4d-4e95-89c4-0ce41228a6cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:14:17.319251 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c0e63c81-9284-46da-8c29-f2fe449fde88 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Created volume successfully. Dec 11 21:14:18.288802 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-bf76ded5-a363-4018-8753-b8612a75e4d2 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Lock "b'cinder-973376c4-c2de-491a-8c04-190c2ffd5bac-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:14:18.317635 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf76ded5-a363-4018-8753-b8612a75e4d2 tempest-VolumeQuotasAdminTestJSON-1311686007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:18.353413 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf76ded5-a363-4018-8753-b8612a75e4d2 tempest-VolumeQuotasAdminTestJSON-1311686007 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:14:18.353876 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf76ded5-a363-4018-8753-b8612a75e4d2 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Volume volume-973376c4-c2de-491a-8c04-190c2ffd5bac is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:14:18.359677 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf76ded5-a363-4018-8753-b8612a75e4d2 tempest-VolumeQuotasAdminTestJSON-1311686007 None] deleting rbd volume volume-973376c4-c2de-491a-8c04-190c2ffd5bac {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:14:18.578454 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-bf76ded5-a363-4018-8753-b8612a75e4d2 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Created reservations ['2770a173-5b50-4e65-adcc-42700aba792c', '48739499-2db7-47bc-88ba-3990b98ffef3', '460de420-f933-4990-90c6-2d2bb295a3d4', '8f5482a0-4374-4064-9eb6-6560334dcadf'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:14:18.618260 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf76ded5-a363-4018-8753-b8612a75e4d2 tempest-VolumeQuotasAdminTestJSON-1311686007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:18.638863 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-bf76ded5-a363-4018-8753-b8612a75e4d2 tempest-VolumeQuotasAdminTestJSON-1311686007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:18.660635 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-bf76ded5-a363-4018-8753-b8612a75e4d2 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:14:18.664881 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-bf76ded5-a363-4018-8753-b8612a75e4d2 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Deleted volume successfully. Dec 11 21:14:18.677281 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-bf76ded5-a363-4018-8753-b8612a75e4d2 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Lock "b'cinder-973376c4-c2de-491a-8c04-190c2ffd5bac-delete_volume'" released by "delete_volume" :: held 0.389s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:14:19.627628 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:14:19.630946 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:14:19.631383 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:14:19.642993 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Flow 'volume_create_manager' (1ca05bf4-ba44-4301-85e5-44220ea86bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:14:19.646684 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bb2f7b-2db1-4f31-bd59-304f9119e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:19.673835 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:14:19.686367 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bb2f7b-2db1-4f31-bd59-304f9119e46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1933808396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9dd1b324-e373-4860-9f2b-f2ec2076cb63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73479623e5e0477a9ee05e0404dd87ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:14:20Z,use_quota=True,user_id='00bb98cfa8a24921a0fd211e23b2c572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:19.689028 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0d16a6-30ac-4063-ad8f-085d8badd94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:19.691242 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0d16a6-30ac-4063-ad8f-085d8badd94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:19.693666 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e574f71-d18c-4e7a-a64d-aa7e306e6bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:19.695926 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e574f71-d18c-4e7a-a64d-aa7e306e6bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd1b324-e373-4860-9f2b-f2ec2076cb63', 'volume_name': 'volume-9dd1b324-e373-4860-9f2b-f2ec2076cb63', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:19.698422 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de66e71-0576-4ea1-b00c-925008d983d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:19.700547 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de66e71-0576-4ea1-b00c-925008d983d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:19.702781 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533c30d2-dbb7-4a75-a682-653615dd7a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:19.703559 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Volume 9dd1b324-e373-4860-9f2b-f2ec2076cb63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd1b324-e373-4860-9f2b-f2ec2076cb63', 'volume_size': 1} Dec 11 21:14:19.703944 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] creating volume 'volume-9dd1b324-e373-4860-9f2b-f2ec2076cb63' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:14:19.704894 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:19.764645 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:14:19.765013 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:14:19.767144 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533c30d2-dbb7-4a75-a682-653615dd7a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd1b324-e373-4860-9f2b-f2ec2076cb63', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:19.769905 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2502e3-f6bb-4b56-8cfc-2609c92f8692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:19.778338 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Volume volume-9dd1b324-e373-4860-9f2b-f2ec2076cb63 (9dd1b324-e373-4860-9f2b-f2ec2076cb63): created successfully Dec 11 21:14:19.780264 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2502e3-f6bb-4b56-8cfc-2609c92f8692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:19.783249 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Flow 'volume_create_manager' (1ca05bf4-ba44-4301-85e5-44220ea86bb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:14:19.792144 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-073846af-8262-4779-b7d5-4faaa4d8b794 tempest-VolumeQuotasAdminTestJSON-1311686007 None] Created volume successfully. Dec 11 21:14:21.138135 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-2ee06424-3f4c-4f68-b744-3b68ac37052a tempest-VolumeQuotasAdminTestJSON-513566475 None] Transfer volume completed successfully. Dec 11 21:14:21.469324 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d7afc039-0539-443d-b9bb-2195ada4a143 tempest-VolumeQuotasAdminTestJSON-1443030787 None] Lock "b'cinder-9dd1b324-e373-4860-9f2b-f2ec2076cb63-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:14:21.492972 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d7afc039-0539-443d-b9bb-2195ada4a143 tempest-VolumeQuotasAdminTestJSON-1443030787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:21.532568 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d7afc039-0539-443d-b9bb-2195ada4a143 tempest-VolumeQuotasAdminTestJSON-1443030787 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:14:21.532969 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d7afc039-0539-443d-b9bb-2195ada4a143 tempest-VolumeQuotasAdminTestJSON-1443030787 None] Volume volume-9dd1b324-e373-4860-9f2b-f2ec2076cb63 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:14:21.537857 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d7afc039-0539-443d-b9bb-2195ada4a143 tempest-VolumeQuotasAdminTestJSON-1443030787 None] deleting rbd volume volume-9dd1b324-e373-4860-9f2b-f2ec2076cb63 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:14:21.736428 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-d7afc039-0539-443d-b9bb-2195ada4a143 tempest-VolumeQuotasAdminTestJSON-1443030787 None] Created reservations ['0044f8ad-f26c-4c34-a720-f084e2061cb7', '3f06f6a2-0572-4b5a-bfdb-ca0ec4ab88bf', 'd77870ab-1350-4bb7-93cb-b363a859832f', 'e35f58df-dd92-4a3e-b822-46685513159a'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:14:21.775175 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d7afc039-0539-443d-b9bb-2195ada4a143 tempest-VolumeQuotasAdminTestJSON-1443030787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:21.796685 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d7afc039-0539-443d-b9bb-2195ada4a143 tempest-VolumeQuotasAdminTestJSON-1443030787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:21.820160 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-d7afc039-0539-443d-b9bb-2195ada4a143 tempest-VolumeQuotasAdminTestJSON-1443030787 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:14:21.824089 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d7afc039-0539-443d-b9bb-2195ada4a143 tempest-VolumeQuotasAdminTestJSON-1443030787 None] Deleted volume successfully. Dec 11 21:14:21.839657 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d7afc039-0539-443d-b9bb-2195ada4a143 tempest-VolumeQuotasAdminTestJSON-1443030787 None] Lock "b'cinder-9dd1b324-e373-4860-9f2b-f2ec2076cb63-delete_volume'" released by "delete_volume" :: held 0.370s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:14:23.514631 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-cfc3f9d6-4ba8-44c7-a9c0-5f10dab9f861 tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['d539f19d-cf32-42f6-a094-2a1f035f868f', '9d1d0eba-60db-4a0d-aa2e-02ed790d0fb9', '3e1ca576-d59c-4d82-9b48-3c906ca6ad0b', '5a4dcd51-667c-4073-bcd8-3be12f38de96'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:14:23.553592 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-cfc3f9d6-4ba8-44c7-a9c0-5f10dab9f861 tempest-VolumesSnapshotTestJSON-970988873 None] Delete snapshot completed successfully. Dec 11 21:14:23.559020 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-cfc3f9d6-4ba8-44c7-a9c0-5f10dab9f861 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-2d5268c5-51d9-4aca-9844-5ba307633a02-delete_snapshot'" released by "delete_snapshot" :: held 30.222s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:14:24.297802 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-2bf5d4ad-20f2-40bb-9fe1-37cdda592c94 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-ea3a2217-00a3-4554-a66d-0316cde429dd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.034s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:14:24.299929 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2bf5d4ad-20f2-40bb-9fe1-37cdda592c94 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:26.793363 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:14:26.796564 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:14:26.797016 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:14:26.810022 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Flow 'volume_create_manager' (e280ed20-08fd-4dbf-9d7c-d9bb27195c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:14:26.813294 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec079ecf-c50c-48c6-87eb-04d88c3dff59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:26.821036 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:14:26.833222 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec079ecf-c50c-48c6-87eb-04d88c3dff59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-327910843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ce273410-93ab-4b56-985b-4555243aba13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50f38dfc5854e9487b68b03ad532275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:14:27Z,use_quota=True,user_id='76490fdc49f14fce9c36f33ec33dd2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:26.835860 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1bc10a-50b2-4cce-a991-137cfa015c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:26.838055 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1bc10a-50b2-4cce-a991-137cfa015c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:26.840517 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631befac-ee6d-4ba2-b719-45f649de9d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:26.842791 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631befac-ee6d-4ba2-b719-45f649de9d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce273410-93ab-4b56-985b-4555243aba13', 'volume_name': 'volume-ce273410-93ab-4b56-985b-4555243aba13', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:26.845111 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c92248-2815-49d7-a625-606d17b487f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:26.848093 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c92248-2815-49d7-a625-606d17b487f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:26.850399 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180c4d5d-0761-4e74-946c-db9a91b05f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:26.851204 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Volume ce273410-93ab-4b56-985b-4555243aba13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce273410-93ab-4b56-985b-4555243aba13', 'volume_size': 1} Dec 11 21:14:26.851598 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] creating volume 'volume-ce273410-93ab-4b56-985b-4555243aba13' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:14:26.852549 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:26.907293 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:14:26.907662 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:14:26.909780 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180c4d5d-0761-4e74-946c-db9a91b05f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce273410-93ab-4b56-985b-4555243aba13', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:26.912508 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a38cbb0-e39d-431a-bbf1-9da146ca6ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:26.921096 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Volume volume-ce273410-93ab-4b56-985b-4555243aba13 (ce273410-93ab-4b56-985b-4555243aba13): created successfully Dec 11 21:14:26.923008 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a38cbb0-e39d-431a-bbf1-9da146ca6ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:26.926681 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Flow 'volume_create_manager' (e280ed20-08fd-4dbf-9d7c-d9bb27195c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:14:26.933740 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-21c9a21a-7921-414e-a0d0-0d25c2269b94 tempest-VolumesTransfersTest-133636199 None] Created volume successfully. Dec 11 21:14:28.255865 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4012ed80-b863-4379-823b-3d8178f0e2f8 tempest-VolumesTransfersTest-2015824643 None] Transfer volume completed successfully. Dec 11 21:14:28.591045 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-0f374f24-ebc5-4028-90bf-9864e8858151 tempest-VolumesTransfersTest-1508651529 None] Lock "b'cinder-ce273410-93ab-4b56-985b-4555243aba13-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:14:28.615699 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0f374f24-ebc5-4028-90bf-9864e8858151 tempest-VolumesTransfersTest-1508651529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:28.653552 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0f374f24-ebc5-4028-90bf-9864e8858151 tempest-VolumesTransfersTest-1508651529 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:14:28.653982 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0f374f24-ebc5-4028-90bf-9864e8858151 tempest-VolumesTransfersTest-1508651529 None] Volume volume-ce273410-93ab-4b56-985b-4555243aba13 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:14:28.658963 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0f374f24-ebc5-4028-90bf-9864e8858151 tempest-VolumesTransfersTest-1508651529 None] deleting rbd volume volume-ce273410-93ab-4b56-985b-4555243aba13 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:14:28.865703 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-0f374f24-ebc5-4028-90bf-9864e8858151 tempest-VolumesTransfersTest-1508651529 None] Created reservations ['6873f024-6f46-4103-abcc-23da83d5cfae', '9e4a348f-32b6-42a0-ac4c-642b17ab65ff', 'd1f7a948-7adf-4cf7-9e3c-3eb0469374c5', '19089490-c5ee-45b8-9ed7-ef9551eb2309'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:14:28.920720 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0f374f24-ebc5-4028-90bf-9864e8858151 tempest-VolumesTransfersTest-1508651529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:28.943812 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-0f374f24-ebc5-4028-90bf-9864e8858151 tempest-VolumesTransfersTest-1508651529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:28.965865 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-0f374f24-ebc5-4028-90bf-9864e8858151 tempest-VolumesTransfersTest-1508651529 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:14:28.969837 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-0f374f24-ebc5-4028-90bf-9864e8858151 tempest-VolumesTransfersTest-1508651529 None] Deleted volume successfully. Dec 11 21:14:28.981894 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-0f374f24-ebc5-4028-90bf-9864e8858151 tempest-VolumesTransfersTest-1508651529 None] Lock "b'cinder-ce273410-93ab-4b56-985b-4555243aba13-delete_volume'" released by "delete_volume" :: held 0.391s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:14:29.938980 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:14:29.942791 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:14:29.943238 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:14:29.955312 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Flow 'volume_create_manager' (b68b76f6-3103-4f16-bc23-cdbea60d6ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:14:29.959545 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8d5dfc-ead8-46cc-8771-5ebee73454fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:29.965989 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:14:29.979054 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8d5dfc-ead8-46cc-8771-5ebee73454fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1845221236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9d7005ce-ff21-4670-ad97-2173ba125e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50f38dfc5854e9487b68b03ad532275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:14:30Z,use_quota=True,user_id='76490fdc49f14fce9c36f33ec33dd2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:29.981701 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605d9b43-e307-4e15-9f52-dfa37f37f001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:29.984089 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605d9b43-e307-4e15-9f52-dfa37f37f001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:29.986408 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa8e801-31cc-4e68-ae5c-b11acabd7d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:29.988766 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa8e801-31cc-4e68-ae5c-b11acabd7d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d7005ce-ff21-4670-ad97-2173ba125e7e', 'volume_name': 'volume-9d7005ce-ff21-4670-ad97-2173ba125e7e', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:29.991203 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ffb9f1-427b-45af-b0aa-4b4de5325031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:29.993368 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ffb9f1-427b-45af-b0aa-4b4de5325031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:29.995644 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64c439e-21fc-4220-a9ae-d766e312e293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:29.996437 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Volume 9d7005ce-ff21-4670-ad97-2173ba125e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d7005ce-ff21-4670-ad97-2173ba125e7e', 'volume_size': 1} Dec 11 21:14:29.996834 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] creating volume 'volume-9d7005ce-ff21-4670-ad97-2173ba125e7e' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:14:29.997810 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:30.055666 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:14:30.056038 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:14:30.058075 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64c439e-21fc-4220-a9ae-d766e312e293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d7005ce-ff21-4670-ad97-2173ba125e7e', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:30.060299 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c144dac8-a608-4b0d-8bf9-ae10a5a48e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:14:30.069533 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Volume volume-9d7005ce-ff21-4670-ad97-2173ba125e7e (9d7005ce-ff21-4670-ad97-2173ba125e7e): created successfully Dec 11 21:14:30.071566 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c144dac8-a608-4b0d-8bf9-ae10a5a48e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:14:30.076158 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Flow 'volume_create_manager' (b68b76f6-3103-4f16-bc23-cdbea60d6ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:14:30.083885 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-594ffee0-f33b-4966-b6d5-af19752399e4 tempest-VolumesTransfersTest-133636199 None] Created volume successfully. Dec 11 21:14:31.233224 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7115bf40-5a9f-424a-b4d8-4681e489311c tempest-VolumesTransfersTest-1508651529 None] Lock "b'cinder-9d7005ce-ff21-4670-ad97-2173ba125e7e-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:14:31.260818 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7115bf40-5a9f-424a-b4d8-4681e489311c tempest-VolumesTransfersTest-1508651529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:31.298581 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7115bf40-5a9f-424a-b4d8-4681e489311c tempest-VolumesTransfersTest-1508651529 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:14:31.299034 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7115bf40-5a9f-424a-b4d8-4681e489311c tempest-VolumesTransfersTest-1508651529 None] Volume volume-9d7005ce-ff21-4670-ad97-2173ba125e7e is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:14:31.304117 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7115bf40-5a9f-424a-b4d8-4681e489311c tempest-VolumesTransfersTest-1508651529 None] deleting rbd volume volume-9d7005ce-ff21-4670-ad97-2173ba125e7e {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:14:31.546366 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-7115bf40-5a9f-424a-b4d8-4681e489311c tempest-VolumesTransfersTest-1508651529 None] Created reservations ['15130b53-573a-47a4-8356-cdfc6e3c69cd', '2a26b48d-9ec5-45d4-a7e0-ffabeaf96836', '64e196cf-16dd-4df7-8bd5-0ca34c402090', '34adfe7a-07b0-4cf0-8203-1d2948e91d39'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:14:31.585630 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7115bf40-5a9f-424a-b4d8-4681e489311c tempest-VolumesTransfersTest-1508651529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:31.606905 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7115bf40-5a9f-424a-b4d8-4681e489311c tempest-VolumesTransfersTest-1508651529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:31.630208 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7115bf40-5a9f-424a-b4d8-4681e489311c tempest-VolumesTransfersTest-1508651529 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:14:31.634155 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7115bf40-5a9f-424a-b4d8-4681e489311c tempest-VolumesTransfersTest-1508651529 None] Deleted volume successfully. Dec 11 21:14:31.645175 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7115bf40-5a9f-424a-b4d8-4681e489311c tempest-VolumesTransfersTest-1508651529 None] Lock "b'cinder-9d7005ce-ff21-4670-ad97-2173ba125e7e-delete_volume'" released by "delete_volume" :: held 0.412s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:14:54.447798 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-2bf5d4ad-20f2-40bb-9fe1-37cdda592c94 tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['ae58899f-1761-4483-ba50-809770876891', '7ca48f4c-4e5d-4ebb-9562-8d723f767fdf', 'ecd759ad-e2be-43a7-9d9d-a610990549df', '5556d829-7c7c-42a1-965b-b37d8201602e'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:14:54.483199 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-2bf5d4ad-20f2-40bb-9fe1-37cdda592c94 tempest-VolumesSnapshotTestJSON-970988873 None] Delete snapshot completed successfully. Dec 11 21:14:54.489131 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-2bf5d4ad-20f2-40bb-9fe1-37cdda592c94 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-ea3a2217-00a3-4554-a66d-0316cde429dd-delete_snapshot'" released by "delete_snapshot" :: held 30.192s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:14:55.272640 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-744c6730-a2b4-42a7-adfb-aa763bb366ca tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-b1fe431c-2088-49b2-98fa-6385f936f981-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:14:55.274469 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-744c6730-a2b4-42a7-adfb-aa763bb366ca tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:55.848567 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:14:55.849368 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:55.913717 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:14:55.949460 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:15:25.412856 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-744c6730-a2b4-42a7-adfb-aa763bb366ca tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['e1f4ddb1-e1cc-4b55-81d1-c70d86f9f6a6', '93bd9d90-7a9f-48a4-9a7a-bd285fa358a9', 'e7bcabc8-0e19-4226-bb33-1d58ecc7f2d7', '166d295d-5170-424a-b5d0-75ed05e06d7a'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:15:25.444107 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-744c6730-a2b4-42a7-adfb-aa763bb366ca tempest-VolumesSnapshotTestJSON-970988873 None] Delete snapshot completed successfully. Dec 11 21:15:25.448683 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-744c6730-a2b4-42a7-adfb-aa763bb366ca tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-b1fe431c-2088-49b2-98fa-6385f936f981-delete_snapshot'" released by "delete_snapshot" :: held 30.176s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:15:26.882317 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-49c11d39-23a8-4e87-9ab1-d08681082f43 req-2472ad4d-838f-418c-9c82-0d7805299031 tempest-VolumesSnapshotTestJSON-970988873 None] Terminate volume connection completed successfully. Dec 11 21:15:26.883060 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-49c11d39-23a8-4e87-9ab1-d08681082f43 req-2472ad4d-838f-418c-9c82-0d7805299031 tempest-VolumesSnapshotTestJSON-970988873 None] Deleting attachment 1e291f8b-9890-42ab-b883-9b2ec835f679. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:15:31.540209 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:15:31.543586 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:15:31.544040 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:15:31.563123 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Flow 'volume_create_manager' (93976283-477f-4554-89fb-af1454ab9655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:15:31.566601 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747aca48-0e3b-4bcb-a7c3-5e0951eb9bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:31.573107 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:15:31.586440 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747aca48-0e3b-4bcb-a7c3-5e0951eb9bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1732699480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b242c9ed-ca39-4845-aad5-a78c6df1ed8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4720aeed7bbd42e2aa8790c9c63b0d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:15:31Z,use_quota=True,user_id='88d74179d55a4b4193ac3f2a473677c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:31.589884 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1adeac69-5562-4652-b7f0-b0d0240365a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:31.592702 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1adeac69-5562-4652-b7f0-b0d0240365a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:31.595266 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b6e79b-3eb7-46ab-a9aa-c2a183b39380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:31.598709 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b6e79b-3eb7-46ab-a9aa-c2a183b39380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b242c9ed-ca39-4845-aad5-a78c6df1ed8c', 'volume_name': 'volume-b242c9ed-ca39-4845-aad5-a78c6df1ed8c', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:31.601486 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a9312f-f5ab-419d-8dae-555569901a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:31.603728 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a9312f-f5ab-419d-8dae-555569901a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:31.606001 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e42885-b57a-405e-8d29-b9e3fd4dde59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:31.606812 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Volume b242c9ed-ca39-4845-aad5-a78c6df1ed8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b242c9ed-ca39-4845-aad5-a78c6df1ed8c', 'volume_size': 1} Dec 11 21:15:31.607214 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] creating volume 'volume-b242c9ed-ca39-4845-aad5-a78c6df1ed8c' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:15:31.608200 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:31.694656 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:15:31.695102 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:15:31.697657 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e42885-b57a-405e-8d29-b9e3fd4dde59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b242c9ed-ca39-4845-aad5-a78c6df1ed8c', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:31.700288 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b9eed8-d36e-48b0-bd5c-597eea5b4a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:31.715738 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Volume volume-b242c9ed-ca39-4845-aad5-a78c6df1ed8c (b242c9ed-ca39-4845-aad5-a78c6df1ed8c): created successfully Dec 11 21:15:31.717759 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b9eed8-d36e-48b0-bd5c-597eea5b4a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:31.720984 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Flow 'volume_create_manager' (93976283-477f-4554-89fb-af1454ab9655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:15:31.729317 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1684a91c-56cf-4998-ba03-b388bd54743e tempest-VolumesSnapshotTestJSON-970988873 None] Created volume successfully. Dec 11 21:15:32.696586 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9f244746-46c6-4f33-999f-92f1f4d5cf0b tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:33.868175 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9f244746-46c6-4f33-999f-92f1f4d5cf0b tempest-VolumesSnapshotTestJSON-970988873 None] Create snapshot completed successfully Dec 11 21:15:35.068429 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:15:35.071670 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:15:35.072115 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:15:35.097463 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Flow 'volume_create_manager' (077526e4-a1ae-4e1e-b09e-bb3f3a997ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:15:35.102612 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfde44c6-ef76-4a60-8eb0-a652f930e1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:35.109699 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:15:35.129128 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfde44c6-ef76-4a60-8eb0-a652f930e1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1028123727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6670b62f-dea7-4231-b7f1-c54b9a699852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4720aeed7bbd42e2aa8790c9c63b0d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:15:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1828a302-02a8-45ee-b4e3-a006452b0dc2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:15:35Z,use_quota=True,user_id='88d74179d55a4b4193ac3f2a473677c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:35.132466 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80224a6d-f0a6-4ba1-a8bd-382dc99194d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:35.134959 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80224a6d-f0a6-4ba1-a8bd-382dc99194d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:35.137873 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37710810-9c58-46af-a5cd-60d5d05f05b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:35.140234 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37710810-9c58-46af-a5cd-60d5d05f05b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6670b62f-dea7-4231-b7f1-c54b9a699852', 'volume_name': 'volume-6670b62f-dea7-4231-b7f1-c54b9a699852', 'volume_size': 2, 'snapshot_id': '1828a302-02a8-45ee-b4e3-a006452b0dc2'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:35.142744 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2202b1-fed4-4392-88b1-33382a76e260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:35.147499 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2202b1-fed4-4392-88b1-33382a76e260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:35.147499 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7e64e6-5e7e-4977-9d9c-d857fab4b21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:35.148270 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Volume 6670b62f-dea7-4231-b7f1-c54b9a699852: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6670b62f-dea7-4231-b7f1-c54b9a699852', 'volume_size': 2, 'snapshot_id': '1828a302-02a8-45ee-b4e3-a006452b0dc2'} Dec 11 21:15:35.186201 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] cloning volumes/volume-b242c9ed-ca39-4845-aad5-a78c6df1ed8c@snapshot-1828a302-02a8-45ee-b4e3-a006452b0dc2 to volume-6670b62f-dea7-4231-b7f1-c54b9a699852 {{(pid=134173) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 11 21:15:35.186496 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:35.232541 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:35.360293 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:15:35.361498 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:15:35.365873 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:35.477440 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7e64e6-5e7e-4977-9d9c-d857fab4b21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6670b62f-dea7-4231-b7f1-c54b9a699852', 'volume_size': 2, 'snapshot_id': '1828a302-02a8-45ee-b4e3-a006452b0dc2'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:35.479820 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a2fd87-e186-402f-b2c8-4f654614d5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:35.488216 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Volume volume-6670b62f-dea7-4231-b7f1-c54b9a699852 (6670b62f-dea7-4231-b7f1-c54b9a699852): created successfully Dec 11 21:15:35.490157 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a2fd87-e186-402f-b2c8-4f654614d5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:35.493183 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Flow 'volume_create_manager' (077526e4-a1ae-4e1e-b09e-bb3f3a997ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:15:35.505679 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9df5e320-281c-42f8-9e6b-f7a93eb6278e tempest-VolumesSnapshotTestJSON-970988873 None] Created volume successfully. Dec 11 21:15:36.185929 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-09a9d60c-3653-4528-8370-93f63dda05df tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-6670b62f-dea7-4231-b7f1-c54b9a699852-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:15:36.239365 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-09a9d60c-3653-4528-8370-93f63dda05df tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:36.310247 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-09a9d60c-3653-4528-8370-93f63dda05df tempest-VolumesSnapshotTestJSON-970988873 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:15:36.324758 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-09a9d60c-3653-4528-8370-93f63dda05df tempest-VolumesSnapshotTestJSON-970988873 None] deleting rbd volume volume-6670b62f-dea7-4231-b7f1-c54b9a699852 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:15:36.603614 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-09a9d60c-3653-4528-8370-93f63dda05df tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['a60a9b3c-5354-4a32-8265-0782cccc78a2', '938b58f8-4ebc-48f5-951c-831d3a81683a', '5b7bcea3-70f7-4c13-aeb0-4ca1a1fbb408', '17110d25-785e-4a6b-8f77-5a67f8ee5a59'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:15:36.651567 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-09a9d60c-3653-4528-8370-93f63dda05df tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:36.681775 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-09a9d60c-3653-4528-8370-93f63dda05df tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:36.711325 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-09a9d60c-3653-4528-8370-93f63dda05df tempest-VolumesSnapshotTestJSON-970988873 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:15:36.716027 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-09a9d60c-3653-4528-8370-93f63dda05df tempest-VolumesSnapshotTestJSON-970988873 None] Deleted volume successfully. Dec 11 21:15:36.734640 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-09a9d60c-3653-4528-8370-93f63dda05df tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-6670b62f-dea7-4231-b7f1-c54b9a699852-delete_volume'" released by "delete_volume" :: held 0.549s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:15:37.562664 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:15:37.565995 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:15:37.566437 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:15:37.578750 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Flow 'volume_create_manager' (62a26ecf-f5c6-4188-aec5-91d43253c3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:15:37.583100 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8087b231-e0e7-4eb4-86ab-ae015f73f6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:37.589022 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:15:37.601991 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8087b231-e0e7-4eb4-86ab-ae015f73f6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1461165633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2514cb45-cdd0-4ed4-ad32-552c353edfa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4720aeed7bbd42e2aa8790c9c63b0d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:15:38Z,use_quota=True,user_id='88d74179d55a4b4193ac3f2a473677c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:37.604661 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dfd1a0-5ee1-4a94-8347-9567e789bfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:37.606859 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dfd1a0-5ee1-4a94-8347-9567e789bfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:37.609304 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a407c6d-89be-4336-94c7-4652739fcc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:37.611608 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a407c6d-89be-4336-94c7-4652739fcc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2514cb45-cdd0-4ed4-ad32-552c353edfa1', 'volume_name': 'volume-2514cb45-cdd0-4ed4-ad32-552c353edfa1', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:37.613954 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275b4a7d-021f-4ba5-b270-a361afedfee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:37.616123 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275b4a7d-021f-4ba5-b270-a361afedfee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:37.618352 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9ffa69-0688-4152-a231-324cedb15f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:37.619166 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Volume 2514cb45-cdd0-4ed4-ad32-552c353edfa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2514cb45-cdd0-4ed4-ad32-552c353edfa1', 'volume_size': 1} Dec 11 21:15:37.619545 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] creating volume 'volume-2514cb45-cdd0-4ed4-ad32-552c353edfa1' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:15:37.620506 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:37.671319 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:15:37.671627 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:15:37.673695 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9ffa69-0688-4152-a231-324cedb15f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2514cb45-cdd0-4ed4-ad32-552c353edfa1', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:37.675984 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f0d67f-fe56-4072-8488-b521b2056104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:37.685555 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Volume volume-2514cb45-cdd0-4ed4-ad32-552c353edfa1 (2514cb45-cdd0-4ed4-ad32-552c353edfa1): created successfully Dec 11 21:15:37.687503 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f0d67f-fe56-4072-8488-b521b2056104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:37.691070 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Flow 'volume_create_manager' (62a26ecf-f5c6-4188-aec5-91d43253c3f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:15:37.699800 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-2ce719c6-150f-4333-8a10-fe7a6426818f tempest-VolumesSnapshotTestJSON-970988873 None] Created volume successfully. Dec 11 21:15:38.746743 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-50dfbbac-c5bd-4c23-80ab-0709adebe389 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:39.026430 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-50dfbbac-c5bd-4c23-80ab-0709adebe389 tempest-VolumesSnapshotTestJSON-970988873 None] Create snapshot completed successfully Dec 11 21:15:40.099257 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:15:40.102446 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:15:40.102915 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:15:40.128908 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Flow 'volume_create_manager' (68aa977a-e6ba-4b6e-98b9-eefdbdd2ef61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:15:40.132113 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c6c2a4-52c5-476b-87bc-1aa50aaca9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:40.138370 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:15:40.150522 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c6c2a4-52c5-476b-87bc-1aa50aaca9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1185866304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1dc073eb-bb1d-4c06-b419-35008ffa2b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4720aeed7bbd42e2aa8790c9c63b0d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=878d30af-38d7-47f9-89d5-4271e52dcf20,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:15:40Z,use_quota=True,user_id='88d74179d55a4b4193ac3f2a473677c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:40.153120 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60662e4-d2ac-4e9d-8de2-bb47e70b578c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:40.155304 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60662e4-d2ac-4e9d-8de2-bb47e70b578c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:40.158223 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51c2f5f-3de4-43f3-a226-60a6af6737e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:40.160513 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51c2f5f-3de4-43f3-a226-60a6af6737e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1dc073eb-bb1d-4c06-b419-35008ffa2b1a', 'volume_name': 'volume-1dc073eb-bb1d-4c06-b419-35008ffa2b1a', 'volume_size': 1, 'snapshot_id': '878d30af-38d7-47f9-89d5-4271e52dcf20'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:40.162859 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa98f36-f40f-44be-b06f-7ca5055880f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:40.164980 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa98f36-f40f-44be-b06f-7ca5055880f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:40.167233 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16383137-d31e-4c66-a12c-934194fdd938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:40.168009 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Volume 1dc073eb-bb1d-4c06-b419-35008ffa2b1a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1dc073eb-bb1d-4c06-b419-35008ffa2b1a', 'volume_size': 1, 'snapshot_id': '878d30af-38d7-47f9-89d5-4271e52dcf20'} Dec 11 21:15:40.187977 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] cloning volumes/volume-2514cb45-cdd0-4ed4-ad32-552c353edfa1@snapshot-878d30af-38d7-47f9-89d5-4271e52dcf20 to volume-1dc073eb-bb1d-4c06-b419-35008ffa2b1a {{(pid=134173) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 11 21:15:40.188939 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:40.232078 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:40.332265 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:15:40.332627 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:15:40.349474 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16383137-d31e-4c66-a12c-934194fdd938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dc073eb-bb1d-4c06-b419-35008ffa2b1a', 'volume_size': 1, 'snapshot_id': '878d30af-38d7-47f9-89d5-4271e52dcf20'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:40.352134 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65daba13-d8e2-43ad-8396-f5316f21b24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:15:40.359764 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Volume volume-1dc073eb-bb1d-4c06-b419-35008ffa2b1a (1dc073eb-bb1d-4c06-b419-35008ffa2b1a): created successfully Dec 11 21:15:40.361884 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65daba13-d8e2-43ad-8396-f5316f21b24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:15:40.364797 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Flow 'volume_create_manager' (68aa977a-e6ba-4b6e-98b9-eefdbdd2ef61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:15:40.376913 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b468cc67-17e1-4f5c-a939-7f8d1b6223a3 tempest-VolumesSnapshotTestJSON-970988873 None] Created volume successfully. Dec 11 21:15:41.203424 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-5cbbac3d-a414-4a6f-bc9a-cf07ef8b9e15 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-1dc073eb-bb1d-4c06-b419-35008ffa2b1a-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:15:41.233680 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5cbbac3d-a414-4a6f-bc9a-cf07ef8b9e15 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:41.297791 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5cbbac3d-a414-4a6f-bc9a-cf07ef8b9e15 tempest-VolumesSnapshotTestJSON-970988873 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:15:41.304570 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5cbbac3d-a414-4a6f-bc9a-cf07ef8b9e15 tempest-VolumesSnapshotTestJSON-970988873 None] deleting rbd volume volume-1dc073eb-bb1d-4c06-b419-35008ffa2b1a {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:15:41.523541 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-5cbbac3d-a414-4a6f-bc9a-cf07ef8b9e15 tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['17b13f13-7b41-4029-86ed-ca2063caa1b2', '5b2b04f5-59bd-4bec-96e3-8806432b01da', 'cf7c04f5-5b6c-4e59-8f8c-70891808d341', 'bf33b72a-4a1a-4de6-8edf-31e82d02ce51'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:15:41.562362 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5cbbac3d-a414-4a6f-bc9a-cf07ef8b9e15 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:41.583725 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5cbbac3d-a414-4a6f-bc9a-cf07ef8b9e15 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:41.606096 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-5cbbac3d-a414-4a6f-bc9a-cf07ef8b9e15 tempest-VolumesSnapshotTestJSON-970988873 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:15:41.611585 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-5cbbac3d-a414-4a6f-bc9a-cf07ef8b9e15 tempest-VolumesSnapshotTestJSON-970988873 None] Deleted volume successfully. Dec 11 21:15:41.623464 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-5cbbac3d-a414-4a6f-bc9a-cf07ef8b9e15 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-1dc073eb-bb1d-4c06-b419-35008ffa2b1a-delete_volume'" released by "delete_volume" :: held 0.420s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:15:42.363511 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-81057b49-a3da-489e-ad2e-db563ab12793 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-878d30af-38d7-47f9-89d5-4271e52dcf20-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:15:42.365137 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-81057b49-a3da-489e-ad2e-db563ab12793 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:43.058937 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-81057b49-a3da-489e-ad2e-db563ab12793 tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['626ca7ec-a9d5-4794-a920-859cd94364ec', 'd6ae6de3-885c-4594-90b0-3ea30e54b9b1', '1b61a10d-68dc-4769-85b0-ae79472dba79', '893f491f-6b11-41a7-a472-aaf64a194bd0'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:15:43.091527 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-81057b49-a3da-489e-ad2e-db563ab12793 tempest-VolumesSnapshotTestJSON-970988873 None] Delete snapshot completed successfully. Dec 11 21:15:43.096867 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-81057b49-a3da-489e-ad2e-db563ab12793 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-878d30af-38d7-47f9-89d5-4271e52dcf20-delete_snapshot'" released by "delete_snapshot" :: held 0.733s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:15:43.461005 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7d342842-fbfc-4a47-b489-c592704e6f73 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-2514cb45-cdd0-4ed4-ad32-552c353edfa1-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:15:43.494336 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7d342842-fbfc-4a47-b489-c592704e6f73 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:43.533167 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7d342842-fbfc-4a47-b489-c592704e6f73 tempest-VolumesSnapshotTestJSON-970988873 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:15:43.533542 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7d342842-fbfc-4a47-b489-c592704e6f73 tempest-VolumesSnapshotTestJSON-970988873 None] Volume volume-2514cb45-cdd0-4ed4-ad32-552c353edfa1 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:15:43.539315 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7d342842-fbfc-4a47-b489-c592704e6f73 tempest-VolumesSnapshotTestJSON-970988873 None] deleting rbd volume volume-2514cb45-cdd0-4ed4-ad32-552c353edfa1 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:15:43.744853 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-7d342842-fbfc-4a47-b489-c592704e6f73 tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['f100be2b-8fab-45ca-ba0c-fd45cb8b96f6', 'd4672aab-4c68-4a3f-9ba0-33ed753ec24b', '233f0a13-ae07-4448-9217-872355e7e12a', '33c848db-1b0e-4bbe-a235-c318818e13d4'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:15:43.787182 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7d342842-fbfc-4a47-b489-c592704e6f73 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:43.808454 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7d342842-fbfc-4a47-b489-c592704e6f73 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:43.832663 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7d342842-fbfc-4a47-b489-c592704e6f73 tempest-VolumesSnapshotTestJSON-970988873 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:15:43.836461 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7d342842-fbfc-4a47-b489-c592704e6f73 tempest-VolumesSnapshotTestJSON-970988873 None] Deleted volume successfully. Dec 11 21:15:43.847722 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7d342842-fbfc-4a47-b489-c592704e6f73 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-2514cb45-cdd0-4ed4-ad32-552c353edfa1-delete_volume'" released by "delete_volume" :: held 0.387s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:15:44.607747 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7f495b81-173f-4a91-9efa-b04d717cdc9d tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-1828a302-02a8-45ee-b4e3-a006452b0dc2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:15:44.609416 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7f495b81-173f-4a91-9efa-b04d717cdc9d tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:44.870840 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-7f495b81-173f-4a91-9efa-b04d717cdc9d tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['03595cf3-4003-4f77-96ba-96fe1087fe8c', '7d278422-cdf7-434d-bbab-0daed67e6361', '66fa0d29-0d17-4674-ba81-af21e1c72ea0', '28ad7d60-4784-4beb-9e72-5c35e8a3bf94'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:15:44.909865 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7f495b81-173f-4a91-9efa-b04d717cdc9d tempest-VolumesSnapshotTestJSON-970988873 None] Delete snapshot completed successfully. Dec 11 21:15:44.919742 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7f495b81-173f-4a91-9efa-b04d717cdc9d tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-1828a302-02a8-45ee-b4e3-a006452b0dc2-delete_snapshot'" released by "delete_snapshot" :: held 0.312s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:15:45.720401 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-9beb78e2-3d6c-4c2e-9cd0-3a9a9de68f62 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-b242c9ed-ca39-4845-aad5-a78c6df1ed8c-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:15:45.761317 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9beb78e2-3d6c-4c2e-9cd0-3a9a9de68f62 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:45.805796 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9beb78e2-3d6c-4c2e-9cd0-3a9a9de68f62 tempest-VolumesSnapshotTestJSON-970988873 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:15:45.806157 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9beb78e2-3d6c-4c2e-9cd0-3a9a9de68f62 tempest-VolumesSnapshotTestJSON-970988873 None] Volume volume-b242c9ed-ca39-4845-aad5-a78c6df1ed8c is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:15:45.814967 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9beb78e2-3d6c-4c2e-9cd0-3a9a9de68f62 tempest-VolumesSnapshotTestJSON-970988873 None] deleting rbd volume volume-b242c9ed-ca39-4845-aad5-a78c6df1ed8c {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:15:46.026074 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-9beb78e2-3d6c-4c2e-9cd0-3a9a9de68f62 tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['26404606-6385-4636-abd6-10a91dda7561', '702a235c-c3a8-46f6-be22-0adb30a0d3e1', '3cfb0639-d2d8-4301-9cbf-777e1b16bc8a', 'ad7f8aec-fbf9-49e4-a8d6-ca9cdee1e08b'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:15:46.079617 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9beb78e2-3d6c-4c2e-9cd0-3a9a9de68f62 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:46.106036 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9beb78e2-3d6c-4c2e-9cd0-3a9a9de68f62 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:46.141744 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-9beb78e2-3d6c-4c2e-9cd0-3a9a9de68f62 tempest-VolumesSnapshotTestJSON-970988873 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:15:46.145577 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9beb78e2-3d6c-4c2e-9cd0-3a9a9de68f62 tempest-VolumesSnapshotTestJSON-970988873 None] Deleted volume successfully. Dec 11 21:15:46.158414 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-9beb78e2-3d6c-4c2e-9cd0-3a9a9de68f62 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-b242c9ed-ca39-4845-aad5-a78c6df1ed8c-delete_volume'" released by "delete_volume" :: held 0.438s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:15:46.978711 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8b0aef84-2dc3-46df-b869-b3388ef4cb9b tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-d439c366-f8ce-44a8-806c-887821415191-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:15:47.024838 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8b0aef84-2dc3-46df-b869-b3388ef4cb9b tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:47.113373 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8b0aef84-2dc3-46df-b869-b3388ef4cb9b tempest-VolumesSnapshotTestJSON-970988873 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:15:47.120790 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8b0aef84-2dc3-46df-b869-b3388ef4cb9b tempest-VolumesSnapshotTestJSON-970988873 None] deleting rbd volume volume-d439c366-f8ce-44a8-806c-887821415191 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:15:47.358284 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8b0aef84-2dc3-46df-b869-b3388ef4cb9b tempest-VolumesSnapshotTestJSON-970988873 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:15:47.391919 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8b0aef84-2dc3-46df-b869-b3388ef4cb9b tempest-VolumesSnapshotTestJSON-970988873 None] deleting parent snapshot volume-d439c366-f8ce-44a8-806c-887821415191.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:15:47.882676 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-8b0aef84-2dc3-46df-b869-b3388ef4cb9b tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['f6f253a6-a46f-4574-8bc8-d3198d40cb5a', 'abb7d34c-6a5b-425d-bfe7-d1d7dad62da6', 'bfaadbd5-c611-46b6-a118-d0bd83b16331', 'ca1496c1-9554-4f75-91a9-97fb21ba1df2'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:15:47.932446 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8b0aef84-2dc3-46df-b869-b3388ef4cb9b tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:47.958813 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8b0aef84-2dc3-46df-b869-b3388ef4cb9b tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:47.987251 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-8b0aef84-2dc3-46df-b869-b3388ef4cb9b tempest-VolumesSnapshotTestJSON-970988873 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:15:47.993608 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8b0aef84-2dc3-46df-b869-b3388ef4cb9b tempest-VolumesSnapshotTestJSON-970988873 None] Deleted volume successfully. Dec 11 21:15:48.006023 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8b0aef84-2dc3-46df-b869-b3388ef4cb9b tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-d439c366-f8ce-44a8-806c-887821415191-delete_volume'" released by "delete_volume" :: held 1.027s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:15:48.103382 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c60f7a93-7355-4473-95ef-664bf85ba45a tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-0e151072-24bc-4b61-996a-553a6eb49ce8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:15:48.105027 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c60f7a93-7355-4473-95ef-664bf85ba45a tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:48.932093 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-c60f7a93-7355-4473-95ef-664bf85ba45a tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['d9475d76-6bcc-434c-b6f5-231bacea4c91', '2dd1253e-0ac7-4a8e-8649-35bbbeec8403', '7f4eb214-4c02-44d9-8bab-4d028e6443ae', '9fc45249-d886-4e61-a625-b294484fe72e'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:15:48.975380 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c60f7a93-7355-4473-95ef-664bf85ba45a tempest-VolumesSnapshotTestJSON-970988873 None] Delete snapshot completed successfully. Dec 11 21:15:48.980188 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c60f7a93-7355-4473-95ef-664bf85ba45a tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-0e151072-24bc-4b61-996a-553a6eb49ce8-delete_snapshot'" released by "delete_snapshot" :: held 0.877s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:15:49.217499 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8c753e37-1d9e-4dbf-8ae7-1feda063ff17 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-a5ad3712-ba49-4336-9ea6-4de8b933fc6f-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:15:49.254559 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8c753e37-1d9e-4dbf-8ae7-1feda063ff17 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:49.295853 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8c753e37-1d9e-4dbf-8ae7-1feda063ff17 tempest-VolumesSnapshotTestJSON-970988873 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:15:49.296285 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8c753e37-1d9e-4dbf-8ae7-1feda063ff17 tempest-VolumesSnapshotTestJSON-970988873 None] Volume volume-a5ad3712-ba49-4336-9ea6-4de8b933fc6f is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:15:49.309384 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8c753e37-1d9e-4dbf-8ae7-1feda063ff17 tempest-VolumesSnapshotTestJSON-970988873 None] deleting rbd volume volume-a5ad3712-ba49-4336-9ea6-4de8b933fc6f {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:15:49.606062 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-8c753e37-1d9e-4dbf-8ae7-1feda063ff17 tempest-VolumesSnapshotTestJSON-970988873 None] Created reservations ['8d0c7e43-ea1a-4075-8382-4852f9b195be', '41279b01-0db9-4b1c-b16c-ac3133a3e631', 'a1955b32-ae5e-487f-856e-0ad5a37b345e', 'a540e239-f754-46f4-bdb3-964fcbd6505e'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:15:49.646096 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8c753e37-1d9e-4dbf-8ae7-1feda063ff17 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:49.669418 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8c753e37-1d9e-4dbf-8ae7-1feda063ff17 tempest-VolumesSnapshotTestJSON-970988873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:49.693490 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-8c753e37-1d9e-4dbf-8ae7-1feda063ff17 tempest-VolumesSnapshotTestJSON-970988873 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:15:49.697724 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8c753e37-1d9e-4dbf-8ae7-1feda063ff17 tempest-VolumesSnapshotTestJSON-970988873 None] Deleted volume successfully. Dec 11 21:15:49.709835 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8c753e37-1d9e-4dbf-8ae7-1feda063ff17 tempest-VolumesSnapshotTestJSON-970988873 None] Lock "b'cinder-a5ad3712-ba49-4336-9ea6-4de8b933fc6f-delete_volume'" released by "delete_volume" :: held 0.492s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:15:55.846945 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:15:55.847642 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:55.924238 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:15:55.987520 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:16:01.105395 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:16:01.109211 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:16:01.110506 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:16:01.123182 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Flow 'volume_create_manager' (0aaaeff2-ac2e-42e3-9b7a-acd4c617d317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:16:01.126421 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2141b42a-ca02-4cec-93da-456af1d25f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:01.133080 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:16:01.145061 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2141b42a-ca02-4cec-93da-456af1d25f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-869580321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=91367eb9-c68e-4706-b90d-3458b60402b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8c23b577a41445f8d98e859bd185062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:16:01Z,use_quota=True,user_id='c096e4f6ff5a4b7cb4eeef1613f235ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:01.147944 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737eb35b-995c-4caf-b15a-cc49865ba384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:01.150119 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737eb35b-995c-4caf-b15a-cc49865ba384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:01.152670 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527e4d10-e0a3-40fb-af2a-87dae88ad063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:01.154943 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527e4d10-e0a3-40fb-af2a-87dae88ad063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91367eb9-c68e-4706-b90d-3458b60402b3', 'volume_name': 'volume-91367eb9-c68e-4706-b90d-3458b60402b3', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:01.157801 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c244bb84-92d6-42fa-a69f-215188de7645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:01.159966 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c244bb84-92d6-42fa-a69f-215188de7645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:01.162169 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e108749d-ee20-445e-99a8-1d712889ac87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:01.163211 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Volume 91367eb9-c68e-4706-b90d-3458b60402b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91367eb9-c68e-4706-b90d-3458b60402b3', 'volume_size': 1} Dec 11 21:16:01.163826 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] creating volume 'volume-91367eb9-c68e-4706-b90d-3458b60402b3' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:16:01.164997 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:16:01.249495 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:16:01.249871 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:16:01.252058 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e108749d-ee20-445e-99a8-1d712889ac87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91367eb9-c68e-4706-b90d-3458b60402b3', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:01.254256 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33896751-6482-49b5-996e-e4ebf1380017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:01.267076 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Volume volume-91367eb9-c68e-4706-b90d-3458b60402b3 (91367eb9-c68e-4706-b90d-3458b60402b3): created successfully Dec 11 21:16:01.269395 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33896751-6482-49b5-996e-e4ebf1380017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:01.272505 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Flow 'volume_create_manager' (0aaaeff2-ac2e-42e3-9b7a-acd4c617d317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:16:01.287178 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-afc5fd1c-a197-430b-94bc-8d4806467a32 tempest-ServersNegativeTestJSON-1448870888 None] Created volume successfully. Dec 11 21:16:03.290810 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:16:03.294104 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:16:03.294599 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:16:03.309185 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Flow 'volume_create_manager' (8e9eeb17-e8e5-4333-939b-1ce9dcd3c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:16:03.312553 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f13eda5-972e-421a-9452-219a758b2d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:03.320815 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:16:03.337276 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f13eda5-972e-421a-9452-219a758b2d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-76823977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a15b36c5-3431-4be0-a125-5122bad5b295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8c23b577a41445f8d98e859bd185062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:16:03Z,use_quota=True,user_id='c096e4f6ff5a4b7cb4eeef1613f235ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:03.340101 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d027f790-9114-44ad-87ae-7c96ea7e036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:03.342318 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d027f790-9114-44ad-87ae-7c96ea7e036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:03.345290 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bdb8738-f2cf-493b-89aa-03ff2cff9607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:03.348896 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bdb8738-f2cf-493b-89aa-03ff2cff9607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15b36c5-3431-4be0-a125-5122bad5b295', 'volume_name': 'volume-a15b36c5-3431-4be0-a125-5122bad5b295', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:03.352055 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba605cdf-13ba-4735-a6c5-5293183d7296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:03.356745 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba605cdf-13ba-4735-a6c5-5293183d7296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:03.359169 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3fac5e-90cc-487d-ad3f-2b0e749b0c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:03.360243 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Volume a15b36c5-3431-4be0-a125-5122bad5b295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15b36c5-3431-4be0-a125-5122bad5b295', 'volume_size': 1} Dec 11 21:16:03.360672 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] creating volume 'volume-a15b36c5-3431-4be0-a125-5122bad5b295' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:16:03.361757 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:16:03.497140 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:16:03.498328 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:16:03.502361 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3fac5e-90cc-487d-ad3f-2b0e749b0c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15b36c5-3431-4be0-a125-5122bad5b295', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:03.505702 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35ece9a-09ec-4920-815c-980c9d35a56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:03.515515 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Volume volume-a15b36c5-3431-4be0-a125-5122bad5b295 (a15b36c5-3431-4be0-a125-5122bad5b295): created successfully Dec 11 21:16:03.518023 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35ece9a-09ec-4920-815c-980c9d35a56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:03.522075 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Flow 'volume_create_manager' (8e9eeb17-e8e5-4333-939b-1ce9dcd3c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:16:03.531990 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-624978d0-a6b6-4211-b857-1a859575314b tempest-ServersNegativeTestJSON-1448870888 None] Created volume successfully. Dec 11 21:16:33.610014 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:16:33.613976 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:16:33.614613 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:16:33.626941 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Flow 'volume_create_manager' (5d0d5f6e-a80a-4f00-91c8-26fe666fe354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:16:33.630380 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f25319-d147-4c11-8f42-f0ee48589792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:33.637372 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:16:33.650464 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f25319-d147-4c11-8f42-f0ee48589792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1164667186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877d0194d21c485ab3477d5ed73d1970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:16:34Z,use_quota=True,user_id='ce37b5065dd34b50bb4eeafe95e650a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:33.653332 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef88cf97-5cfc-4840-a3b2-7af4a5d53fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:33.655808 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef88cf97-5cfc-4840-a3b2-7af4a5d53fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:33.658887 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14afc07-bc5c-4073-8670-28a98f6a643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:33.661140 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14afc07-bc5c-4073-8670-28a98f6a643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8', 'volume_name': 'volume-1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:33.663485 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11dc0cdd-c0c1-4609-b7b7-2f26009d0f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:33.665595 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11dc0cdd-c0c1-4609-b7b7-2f26009d0f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:33.667840 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c120d4-9631-409d-b633-208c10bae3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:33.668807 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Volume 1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8', 'volume_size': 1} Dec 11 21:16:33.669360 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] creating volume 'volume-1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:16:33.670520 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:16:33.738695 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:16:33.740249 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:16:33.744438 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c120d4-9631-409d-b633-208c10bae3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:33.748407 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5d2655-f216-4bf4-8c66-0a03fb4e4840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:16:33.763402 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Volume volume-1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8 (1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8): created successfully Dec 11 21:16:33.766042 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5d2655-f216-4bf4-8c66-0a03fb4e4840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:16:33.769236 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Flow 'volume_create_manager' (5d0d5f6e-a80a-4f00-91c8-26fe666fe354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:16:33.794666 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1517ad3d-a6b4-4e6b-8cab-6aa9ee32b273 tempest-AttachVolumeShelveTestJSON-486918854 None] Created volume successfully. Dec 11 21:16:55.846024 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:16:55.847210 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:16:55.874875 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:16:55.925051 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:17:12.261026 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-fbb4d8c8-53a2-4bd2-8d83-c08b1034bf83 req-a9bbbd37-8341-4c67-adeb-389069aa4284 tempest-AttachVolumeShelveTestJSON-486918854 None] No connector for attachment c97f8f54-34e8-477b-b41b-dd2bdde2a327; skipping storage backend terminate_connection call. {{(pid=134173) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4903}} Dec 11 21:17:12.261596 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-fbb4d8c8-53a2-4bd2-8d83-c08b1034bf83 req-a9bbbd37-8341-4c67-adeb-389069aa4284 tempest-AttachVolumeShelveTestJSON-486918854 None] Deleting attachment c97f8f54-34e8-477b-b41b-dd2bdde2a327. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:17:19.424852 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8d1f4e79-333c-470a-ba78-eec707884f3e tempest-ServersNegativeTestJSON-1448870888 None] Lock "b'cinder-a15b36c5-3431-4be0-a125-5122bad5b295-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:17:19.461669 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8d1f4e79-333c-470a-ba78-eec707884f3e tempest-ServersNegativeTestJSON-1448870888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:19.561217 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8d1f4e79-333c-470a-ba78-eec707884f3e tempest-ServersNegativeTestJSON-1448870888 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:17:19.561999 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8d1f4e79-333c-470a-ba78-eec707884f3e tempest-ServersNegativeTestJSON-1448870888 None] Volume volume-a15b36c5-3431-4be0-a125-5122bad5b295 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:17:19.571461 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8d1f4e79-333c-470a-ba78-eec707884f3e tempest-ServersNegativeTestJSON-1448870888 None] deleting rbd volume volume-a15b36c5-3431-4be0-a125-5122bad5b295 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:17:20.045612 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-8d1f4e79-333c-470a-ba78-eec707884f3e tempest-ServersNegativeTestJSON-1448870888 None] Created reservations ['5c6fbab5-2ea9-4159-a573-36cedc6a750b', '46b19491-205a-4794-a829-479f79b84261', 'e12e7f06-5724-477b-9c04-b4d2e2993cea', '99049f1d-de1e-4bb4-8409-fd5ac0cc59ad'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:17:20.139883 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8d1f4e79-333c-470a-ba78-eec707884f3e tempest-ServersNegativeTestJSON-1448870888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:20.214765 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8d1f4e79-333c-470a-ba78-eec707884f3e tempest-ServersNegativeTestJSON-1448870888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:20.324562 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-8d1f4e79-333c-470a-ba78-eec707884f3e tempest-ServersNegativeTestJSON-1448870888 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:17:20.329566 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8d1f4e79-333c-470a-ba78-eec707884f3e tempest-ServersNegativeTestJSON-1448870888 None] Deleted volume successfully. Dec 11 21:17:20.347405 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8d1f4e79-333c-470a-ba78-eec707884f3e tempest-ServersNegativeTestJSON-1448870888 None] Lock "b'cinder-a15b36c5-3431-4be0-a125-5122bad5b295-delete_volume'" released by "delete_volume" :: held 0.923s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:17:20.678002 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-f1ab8bae-17b1-4e4a-b204-12e1664894ec tempest-ServersNegativeTestJSON-1448870888 None] Lock "b'cinder-91367eb9-c68e-4706-b90d-3458b60402b3-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:17:20.794445 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f1ab8bae-17b1-4e4a-b204-12e1664894ec tempest-ServersNegativeTestJSON-1448870888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:20.901558 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f1ab8bae-17b1-4e4a-b204-12e1664894ec tempest-ServersNegativeTestJSON-1448870888 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:17:20.902836 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f1ab8bae-17b1-4e4a-b204-12e1664894ec tempest-ServersNegativeTestJSON-1448870888 None] Volume volume-91367eb9-c68e-4706-b90d-3458b60402b3 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:17:20.917487 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f1ab8bae-17b1-4e4a-b204-12e1664894ec tempest-ServersNegativeTestJSON-1448870888 None] deleting rbd volume volume-91367eb9-c68e-4706-b90d-3458b60402b3 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:17:21.393093 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-f1ab8bae-17b1-4e4a-b204-12e1664894ec tempest-ServersNegativeTestJSON-1448870888 None] Created reservations ['a547c89a-891d-4ba8-b891-2ec8b33c7417', '1a2fea7f-5088-4ac7-8a89-f2187de7e298', 'b66ce827-dd63-44a4-953d-942ff52371ed', '102f5ae0-2cfa-4b69-a5dc-4b799778aebc'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:17:21.496293 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f1ab8bae-17b1-4e4a-b204-12e1664894ec tempest-ServersNegativeTestJSON-1448870888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:21.553700 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f1ab8bae-17b1-4e4a-b204-12e1664894ec tempest-ServersNegativeTestJSON-1448870888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:21.606239 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-f1ab8bae-17b1-4e4a-b204-12e1664894ec tempest-ServersNegativeTestJSON-1448870888 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:17:21.612261 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f1ab8bae-17b1-4e4a-b204-12e1664894ec tempest-ServersNegativeTestJSON-1448870888 None] Deleted volume successfully. Dec 11 21:17:21.646092 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-f1ab8bae-17b1-4e4a-b204-12e1664894ec tempest-ServersNegativeTestJSON-1448870888 None] Lock "b'cinder-91367eb9-c68e-4706-b90d-3458b60402b3-delete_volume'" released by "delete_volume" :: held 0.968s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:17:31.421148 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:17:31.426700 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:17:31.426809 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:17:31.439601 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Flow 'volume_create_manager' (fd2b355c-f8f8-41fa-90b3-7adc4decc93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:17:31.442821 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2368b53d-a1c5-4b74-bbfa-e05f1c70e8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:31.448861 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:17:31.462160 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2368b53d-a1c5-4b74-bbfa-e05f1c70e8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1931473055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=010ee260-e923-47e3-a596-a5f6dda9560c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='618bf3ad33004a0fa32187b93c5d257c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:17:31Z,use_quota=True,user_id='acea7459b0da4d679121a5452a314327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:31.464864 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d11f6d8-24c2-443b-a49e-350f9f38ef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:31.467116 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d11f6d8-24c2-443b-a49e-350f9f38ef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:31.470210 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d362697e-c92f-44fd-a032-991b4025e715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:31.472848 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d362697e-c92f-44fd-a032-991b4025e715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010ee260-e923-47e3-a596-a5f6dda9560c', 'volume_name': 'volume-010ee260-e923-47e3-a596-a5f6dda9560c', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:31.475266 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0947362e-adbe-461d-a897-5a907a56c46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:31.477457 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0947362e-adbe-461d-a897-5a907a56c46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:31.479797 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3789398a-5d7a-47b5-b625-142576adaac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:31.480713 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Volume 010ee260-e923-47e3-a596-a5f6dda9560c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010ee260-e923-47e3-a596-a5f6dda9560c', 'volume_size': 1} Dec 11 21:17:31.481166 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] creating volume 'volume-010ee260-e923-47e3-a596-a5f6dda9560c' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:17:31.482240 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:31.547429 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:17:31.547817 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:17:31.549934 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3789398a-5d7a-47b5-b625-142576adaac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010ee260-e923-47e3-a596-a5f6dda9560c', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:31.553070 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97eecf3-c347-4deb-9b72-1e04b05b1e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:31.561307 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Volume volume-010ee260-e923-47e3-a596-a5f6dda9560c (010ee260-e923-47e3-a596-a5f6dda9560c): created successfully Dec 11 21:17:31.563918 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97eecf3-c347-4deb-9b72-1e04b05b1e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:31.567103 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Flow 'volume_create_manager' (fd2b355c-f8f8-41fa-90b3-7adc4decc93b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:17:31.576604 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-15b2c008-ea06-4b57-98e3-300389a84c69 tempest-VolumesTestJSON-750256982 None] Created volume successfully. Dec 11 21:17:32.830768 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:17:32.835013 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:17:32.835466 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:17:32.850331 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Flow 'volume_create_manager' (6c07d427-2123-473e-9020-283ddab54dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:17:32.854620 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9501b7ed-044f-40b0-b12a-b18ed422d1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:32.861556 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:17:32.876083 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9501b7ed-044f-40b0-b12a-b18ed422d1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-172387168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a822d9b9-dcad-44c9-b976-b7d8915c4dcf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='618bf3ad33004a0fa32187b93c5d257c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:17:33Z,use_quota=True,user_id='acea7459b0da4d679121a5452a314327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:32.879282 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78294508-b18d-4fbd-b8b9-4d1149af65fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:32.882193 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78294508-b18d-4fbd-b8b9-4d1149af65fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:32.884694 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb899d5-2b8b-414c-96a5-22f47336449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:32.886988 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb899d5-2b8b-414c-96a5-22f47336449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a822d9b9-dcad-44c9-b976-b7d8915c4dcf', 'volume_name': 'volume-a822d9b9-dcad-44c9-b976-b7d8915c4dcf', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:32.890602 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc35e2e-f3ef-4e72-9fde-b602a56cb727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:32.892753 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc35e2e-f3ef-4e72-9fde-b602a56cb727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:32.895031 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c2b2d0-92fb-4f6d-b6c4-e795846eb5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:32.895812 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Volume a822d9b9-dcad-44c9-b976-b7d8915c4dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a822d9b9-dcad-44c9-b976-b7d8915c4dcf', 'volume_size': 1} Dec 11 21:17:32.896203 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] creating volume 'volume-a822d9b9-dcad-44c9-b976-b7d8915c4dcf' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:17:32.897168 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:32.954142 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:17:32.954543 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:17:32.956689 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c2b2d0-92fb-4f6d-b6c4-e795846eb5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a822d9b9-dcad-44c9-b976-b7d8915c4dcf', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:32.959122 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8893a512-c8b8-4580-ac0d-0103b850f21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:32.967312 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Volume volume-a822d9b9-dcad-44c9-b976-b7d8915c4dcf (a822d9b9-dcad-44c9-b976-b7d8915c4dcf): created successfully Dec 11 21:17:32.969515 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8893a512-c8b8-4580-ac0d-0103b850f21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:32.972955 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Flow 'volume_create_manager' (6c07d427-2123-473e-9020-283ddab54dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:17:32.981009 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b54a79a3-902b-4642-9a15-939e59b889c9 tempest-VolumesTestJSON-750256982 None] Created volume successfully. Dec 11 21:17:34.174570 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:17:34.177541 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:17:34.177969 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:17:34.189971 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Flow 'volume_create_manager' (7f530ce0-3af0-42be-9b2c-b6b033430766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:17:34.193118 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee5199b-3665-4596-8078-7939ebdf8f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:34.199202 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:17:34.213040 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee5199b-3665-4596-8078-7939ebdf8f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1776603590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4ffbde95-6f78-48da-a0eb-1d590a860308,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='618bf3ad33004a0fa32187b93c5d257c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:17:34Z,use_quota=True,user_id='acea7459b0da4d679121a5452a314327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:34.215659 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b65b732-b83c-4203-a810-7ee178f3081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:34.217806 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b65b732-b83c-4203-a810-7ee178f3081f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:34.220865 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49465e68-5dca-486f-ad6f-a1fb45ca1191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:34.223398 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49465e68-5dca-486f-ad6f-a1fb45ca1191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ffbde95-6f78-48da-a0eb-1d590a860308', 'volume_name': 'volume-4ffbde95-6f78-48da-a0eb-1d590a860308', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:34.225709 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcea91bb-fe59-45d1-a58a-d2efdede73f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:34.227839 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcea91bb-fe59-45d1-a58a-d2efdede73f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:34.230043 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1836e816-870d-41af-9b49-245ca9874559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:34.230833 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Volume 4ffbde95-6f78-48da-a0eb-1d590a860308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ffbde95-6f78-48da-a0eb-1d590a860308', 'volume_size': 1} Dec 11 21:17:34.231217 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] creating volume 'volume-4ffbde95-6f78-48da-a0eb-1d590a860308' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:17:34.232179 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:34.289217 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:17:34.289585 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:17:34.291803 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1836e816-870d-41af-9b49-245ca9874559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ffbde95-6f78-48da-a0eb-1d590a860308', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:34.293971 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabb4243-6a3c-4264-8fec-79fe45f07969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:17:34.302157 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Volume volume-4ffbde95-6f78-48da-a0eb-1d590a860308 (4ffbde95-6f78-48da-a0eb-1d590a860308): created successfully Dec 11 21:17:34.304306 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabb4243-6a3c-4264-8fec-79fe45f07969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:17:34.307307 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Flow 'volume_create_manager' (7f530ce0-3af0-42be-9b2c-b6b033430766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:17:34.315173 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-21647fd0-3277-40d4-81c3-5b52deba71f7 tempest-VolumesTestJSON-750256982 None] Created volume successfully. Dec 11 21:17:36.146452 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-677e5fa0-940f-4c9e-a976-fba302086038 tempest-VolumesTestJSON-750256982 None] Lock "b'cinder-4ffbde95-6f78-48da-a0eb-1d590a860308-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:17:36.199110 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-677e5fa0-940f-4c9e-a976-fba302086038 tempest-VolumesTestJSON-750256982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:36.251280 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-677e5fa0-940f-4c9e-a976-fba302086038 tempest-VolumesTestJSON-750256982 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:17:36.251979 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-677e5fa0-940f-4c9e-a976-fba302086038 tempest-VolumesTestJSON-750256982 None] Volume volume-4ffbde95-6f78-48da-a0eb-1d590a860308 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:17:36.268064 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-677e5fa0-940f-4c9e-a976-fba302086038 tempest-VolumesTestJSON-750256982 None] deleting rbd volume volume-4ffbde95-6f78-48da-a0eb-1d590a860308 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:17:36.632142 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-677e5fa0-940f-4c9e-a976-fba302086038 tempest-VolumesTestJSON-750256982 None] Created reservations ['902dd562-8e80-4400-872e-dfffe22eb353', '0943052e-67af-4c2c-b288-009487f289ca', 'bf4a8a8c-86ba-4222-b159-eec8c9cfc866', '12325305-8fa0-48ee-ace1-c27fccb76d1f'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:17:36.681227 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-677e5fa0-940f-4c9e-a976-fba302086038 tempest-VolumesTestJSON-750256982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:36.738161 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-677e5fa0-940f-4c9e-a976-fba302086038 tempest-VolumesTestJSON-750256982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:36.774926 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-677e5fa0-940f-4c9e-a976-fba302086038 tempest-VolumesTestJSON-750256982 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:17:36.779939 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-677e5fa0-940f-4c9e-a976-fba302086038 tempest-VolumesTestJSON-750256982 None] Deleted volume successfully. Dec 11 21:17:36.795935 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-677e5fa0-940f-4c9e-a976-fba302086038 tempest-VolumesTestJSON-750256982 None] Lock "b'cinder-4ffbde95-6f78-48da-a0eb-1d590a860308-delete_volume'" released by "delete_volume" :: held 0.649s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:17:37.441670 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-f5f360f8-ba75-4df5-9256-9f952d5d941c tempest-VolumesTestJSON-750256982 None] Lock "b'cinder-a822d9b9-dcad-44c9-b976-b7d8915c4dcf-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:17:37.477136 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5f360f8-ba75-4df5-9256-9f952d5d941c tempest-VolumesTestJSON-750256982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:37.513288 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5f360f8-ba75-4df5-9256-9f952d5d941c tempest-VolumesTestJSON-750256982 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:17:37.513751 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5f360f8-ba75-4df5-9256-9f952d5d941c tempest-VolumesTestJSON-750256982 None] Volume volume-a822d9b9-dcad-44c9-b976-b7d8915c4dcf is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:17:37.519286 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5f360f8-ba75-4df5-9256-9f952d5d941c tempest-VolumesTestJSON-750256982 None] deleting rbd volume volume-a822d9b9-dcad-44c9-b976-b7d8915c4dcf {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:17:37.814409 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-f5f360f8-ba75-4df5-9256-9f952d5d941c tempest-VolumesTestJSON-750256982 None] Created reservations ['c33e5bbf-45e4-48a3-aa24-cce9059c32df', 'da1889b6-1fdc-466e-b9b7-5fa6079882b7', '15fa38af-5b78-4dcc-94fa-65e0e5a1a2fb', '2f4974fd-54a9-4ccf-981e-93e07e2c4705'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:17:37.868608 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5f360f8-ba75-4df5-9256-9f952d5d941c tempest-VolumesTestJSON-750256982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:37.922833 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f5f360f8-ba75-4df5-9256-9f952d5d941c tempest-VolumesTestJSON-750256982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:37.993234 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-f5f360f8-ba75-4df5-9256-9f952d5d941c tempest-VolumesTestJSON-750256982 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:17:37.998100 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f5f360f8-ba75-4df5-9256-9f952d5d941c tempest-VolumesTestJSON-750256982 None] Deleted volume successfully. Dec 11 21:17:38.012874 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-f5f360f8-ba75-4df5-9256-9f952d5d941c tempest-VolumesTestJSON-750256982 None] Lock "b'cinder-a822d9b9-dcad-44c9-b976-b7d8915c4dcf-delete_volume'" released by "delete_volume" :: held 0.571s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:17:38.574811 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-4b8abc63-9905-4cc1-9501-b5f1863e4156 tempest-VolumesTestJSON-750256982 None] Lock "b'cinder-010ee260-e923-47e3-a596-a5f6dda9560c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:17:38.611750 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4b8abc63-9905-4cc1-9501-b5f1863e4156 tempest-VolumesTestJSON-750256982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:38.693268 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4b8abc63-9905-4cc1-9501-b5f1863e4156 tempest-VolumesTestJSON-750256982 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:17:38.693639 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4b8abc63-9905-4cc1-9501-b5f1863e4156 tempest-VolumesTestJSON-750256982 None] Volume volume-010ee260-e923-47e3-a596-a5f6dda9560c is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:17:38.712108 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4b8abc63-9905-4cc1-9501-b5f1863e4156 tempest-VolumesTestJSON-750256982 None] deleting rbd volume volume-010ee260-e923-47e3-a596-a5f6dda9560c {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:17:39.052648 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-4b8abc63-9905-4cc1-9501-b5f1863e4156 tempest-VolumesTestJSON-750256982 None] Created reservations ['50ea4b22-ceec-49f6-9ce2-7aa1925e700e', '496ceec3-5adf-47aa-82bb-f536333c423e', 'f649b6e5-0868-41bd-97ac-759e12adfefd', '18857efc-2d7f-4614-b323-18839aeae4a5'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:17:39.116150 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4b8abc63-9905-4cc1-9501-b5f1863e4156 tempest-VolumesTestJSON-750256982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:39.174272 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4b8abc63-9905-4cc1-9501-b5f1863e4156 tempest-VolumesTestJSON-750256982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:39.250107 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-4b8abc63-9905-4cc1-9501-b5f1863e4156 tempest-VolumesTestJSON-750256982 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:17:39.256452 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4b8abc63-9905-4cc1-9501-b5f1863e4156 tempest-VolumesTestJSON-750256982 None] Deleted volume successfully. Dec 11 21:17:39.282568 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-4b8abc63-9905-4cc1-9501-b5f1863e4156 tempest-VolumesTestJSON-750256982 None] Lock "b'cinder-010ee260-e923-47e3-a596-a5f6dda9560c-delete_volume'" released by "delete_volume" :: held 0.708s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:17:55.851686 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:17:55.852493 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:55.896734 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:17:55.970442 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:18:55.582236 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-68fc88a6-209f-4499-8210-711034ba0e6b tempest-AttachVolumeShelveTestJSON-486918854 None] Lock "b'cinder-1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:18:55.654354 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-68fc88a6-209f-4499-8210-711034ba0e6b tempest-AttachVolumeShelveTestJSON-486918854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:18:55.748171 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-68fc88a6-209f-4499-8210-711034ba0e6b tempest-AttachVolumeShelveTestJSON-486918854 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:18:55.748596 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-68fc88a6-209f-4499-8210-711034ba0e6b tempest-AttachVolumeShelveTestJSON-486918854 None] Volume volume-1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:18:55.759877 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-68fc88a6-209f-4499-8210-711034ba0e6b tempest-AttachVolumeShelveTestJSON-486918854 None] deleting rbd volume volume-1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:18:55.848759 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:18:55.849379 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:18:55.926972 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:18:55.991134 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:18:56.175508 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-68fc88a6-209f-4499-8210-711034ba0e6b tempest-AttachVolumeShelveTestJSON-486918854 None] Created reservations ['1782a70d-0bb3-494a-885f-0a4b209860da', '79ca863e-c79c-4ae4-894b-83090a824478', 'de2c7855-7311-4fa6-b2e5-97029414309b', 'e6dfa3c3-9fd1-46f8-99ac-830b94605b10'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:18:56.273922 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-68fc88a6-209f-4499-8210-711034ba0e6b tempest-AttachVolumeShelveTestJSON-486918854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:18:56.378110 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-68fc88a6-209f-4499-8210-711034ba0e6b tempest-AttachVolumeShelveTestJSON-486918854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:18:56.447989 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-68fc88a6-209f-4499-8210-711034ba0e6b tempest-AttachVolumeShelveTestJSON-486918854 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:18:56.459076 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-68fc88a6-209f-4499-8210-711034ba0e6b tempest-AttachVolumeShelveTestJSON-486918854 None] Deleted volume successfully. Dec 11 21:18:56.479667 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-68fc88a6-209f-4499-8210-711034ba0e6b tempest-AttachVolumeShelveTestJSON-486918854 None] Lock "b'cinder-1cc1bd54-c208-4cec-ae92-52b6cfb3d6d8-delete_volume'" released by "delete_volume" :: held 0.897s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:18:56.847842 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-3ef57a66-bb4d-4364-a095-c920a954ac91 tempest-AttachVolumeShelveTestJSON-486918854 None] Lock "b'cinder-531e4493-0fa5-4b02-b9c7-c8db7e07cc42-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:18:56.884955 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3ef57a66-bb4d-4364-a095-c920a954ac91 tempest-AttachVolumeShelveTestJSON-486918854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:18:56.943081 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3ef57a66-bb4d-4364-a095-c920a954ac91 tempest-AttachVolumeShelveTestJSON-486918854 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:18:56.943632 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3ef57a66-bb4d-4364-a095-c920a954ac91 tempest-AttachVolumeShelveTestJSON-486918854 None] Volume volume-531e4493-0fa5-4b02-b9c7-c8db7e07cc42 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:18:56.951306 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3ef57a66-bb4d-4364-a095-c920a954ac91 tempest-AttachVolumeShelveTestJSON-486918854 None] deleting rbd volume volume-531e4493-0fa5-4b02-b9c7-c8db7e07cc42 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:18:57.281703 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-3ef57a66-bb4d-4364-a095-c920a954ac91 tempest-AttachVolumeShelveTestJSON-486918854 None] Created reservations ['ce0a66d5-e8c6-4eaf-9d6a-69b470084f29', 'd624b4ed-be1e-4641-9de1-f8eaa5209290', '3fbd8d52-e3d4-4ebb-9d43-dbfd23f35660', '86e830b7-dd85-44d4-85b2-190194ab0235'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:18:57.361899 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3ef57a66-bb4d-4364-a095-c920a954ac91 tempest-AttachVolumeShelveTestJSON-486918854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:18:57.410885 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3ef57a66-bb4d-4364-a095-c920a954ac91 tempest-AttachVolumeShelveTestJSON-486918854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:18:57.466579 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-3ef57a66-bb4d-4364-a095-c920a954ac91 tempest-AttachVolumeShelveTestJSON-486918854 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:18:57.471951 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-3ef57a66-bb4d-4364-a095-c920a954ac91 tempest-AttachVolumeShelveTestJSON-486918854 None] Deleted volume successfully. Dec 11 21:18:57.498858 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-3ef57a66-bb4d-4364-a095-c920a954ac91 tempest-AttachVolumeShelveTestJSON-486918854 None] Lock "b'cinder-531e4493-0fa5-4b02-b9c7-c8db7e07cc42-delete_volume'" released by "delete_volume" :: held 0.651s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:19:07.950538 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:19:07.957230 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:19:07.957880 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:19:07.974579 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Flow 'volume_create_manager' (b62101b3-baf1-41d1-bab6-9ed6c76b22c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:19:07.977867 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac21d22-a805-479c-ac12-93f46138622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:07.989644 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:19:08.006850 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac21d22-a805-479c-ac12-93f46138622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-2050327946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4930315f-a35d-47e5-816e-622618a3ea5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f0381bbbd84752abdbd2d9ae843b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:19:08Z,use_quota=True,user_id='8b579ede23eb483b89f94f8e1696a638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:08.010281 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe54bba3-e334-4988-aa49-f106e02c4c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:08.013088 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe54bba3-e334-4988-aa49-f106e02c4c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:08.016839 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96babda-4d1a-4a4c-b5a2-0042af07e858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:08.187366 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96babda-4d1a-4a4c-b5a2-0042af07e858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4930315f-a35d-47e5-816e-622618a3ea5b', 'volume_name': 'volume-4930315f-a35d-47e5-816e-622618a3ea5b', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:08.190186 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89c244c-d901-4427-bb67-bfaa9e82695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:08.192496 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89c244c-d901-4427-bb67-bfaa9e82695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:08.195487 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1c5145-1984-4980-957e-48dab86a00cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:08.196667 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Volume 4930315f-a35d-47e5-816e-622618a3ea5b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4930315f-a35d-47e5-816e-622618a3ea5b', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 21:19:08.197484 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Cloning 4930315f-a35d-47e5-816e-622618a3ea5b from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 21:19:08.209032 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:19:08.222170 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 19, 8, 213143)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:19:08.222926 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:19:08.223485 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 21:19:08.229083 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:19:08.230574 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 21:19:08.240650 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 19, 8, 237739)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:19:08.241309 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:19:08.241784 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 21:19:08.263797 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:08.354680 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] creating snapshot='volume-4930315f-a35d-47e5-816e-622618a3ea5b.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:19:09.208638 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-4930315f-a35d-47e5-816e-622618a3ea5b.clone_snap' to 'volume-4930315f-a35d-47e5-816e-622618a3ea5b' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:19:09.484606 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:19:09.485745 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:19:09.486147 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:19:09.519322 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:19:09.519987 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Marking volume 4930315f-a35d-47e5-816e-622618a3ea5b as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:19:09.530942 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to 4930315f-a35d-47e5-816e-622618a3ea5b. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 21:19:09.532183 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Creating volume glance metadata for volume 4930315f-a35d-47e5-816e-622618a3ea5b backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 21:19:09.608129 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1c5145-1984-4980-957e-48dab86a00cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4930315f-a35d-47e5-816e-622618a3ea5b', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:09.611738 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5016697-a0ad-4aa3-945b-da2dcfe3d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:09.624317 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Volume volume-4930315f-a35d-47e5-816e-622618a3ea5b (4930315f-a35d-47e5-816e-622618a3ea5b): created successfully Dec 11 21:19:09.626456 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5016697-a0ad-4aa3-945b-da2dcfe3d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:09.631814 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Flow 'volume_create_manager' (b62101b3-baf1-41d1-bab6-9ed6c76b22c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:19:09.642437 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-2166294b-2923-468a-b584-0d7b181a6dfa tempest-TestVolumeBootPattern-909971433 None] Created volume successfully. Dec 11 21:19:10.447439 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ba34b4a5-518a-4437-be39-214f924aeea3 tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:11.363929 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ba34b4a5-518a-4437-be39-214f924aeea3 tempest-TestVolumeBootPattern-909971433 None] Create snapshot completed successfully Dec 11 21:19:14.094709 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:19:14.098578 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:19:14.099027 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:19:14.123802 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Flow 'volume_create_manager' (9046ddaf-10eb-4085-b923-24cd566bd2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:19:14.128100 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d5db27-0afb-4620-a9aa-875581ef1656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:14.134834 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:19:14.153462 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d5db27-0afb-4620-a9aa-875581ef1656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:19:14Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5af74677-0ff1-495e-8304-d139df858d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f0381bbbd84752abdbd2d9ae843b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0ab36a77-45ff-4685-a6ce-2ffb9c4e46bb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:19:14Z,use_quota=True,user_id='8b579ede23eb483b89f94f8e1696a638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:14.160861 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1911832e-c2c7-47d9-a785-596d82c350d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:14.163703 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1911832e-c2c7-47d9-a785-596d82c350d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:14.166158 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d617728a-0fc3-426b-b2b1-b1546fc19a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:14.169097 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d617728a-0fc3-426b-b2b1-b1546fc19a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5af74677-0ff1-495e-8304-d139df858d27', 'volume_name': 'volume-5af74677-0ff1-495e-8304-d139df858d27', 'volume_size': 1, 'snapshot_id': '0ab36a77-45ff-4685-a6ce-2ffb9c4e46bb'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:14.171637 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ad47d9-e793-406f-aed9-a16cd15a3cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:14.174666 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ad47d9-e793-406f-aed9-a16cd15a3cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:14.179020 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b6b309-9aa7-44c7-a274-7cc5d825482e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:14.180281 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Volume 5af74677-0ff1-495e-8304-d139df858d27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5af74677-0ff1-495e-8304-d139df858d27', 'volume_size': 1, 'snapshot_id': '0ab36a77-45ff-4685-a6ce-2ffb9c4e46bb'} Dec 11 21:19:14.206392 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] cloning volumes/volume-4930315f-a35d-47e5-816e-622618a3ea5b@snapshot-0ab36a77-45ff-4685-a6ce-2ffb9c4e46bb to volume-5af74677-0ff1-495e-8304-d139df858d27 {{(pid=134173) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 11 21:19:14.207350 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:14.322920 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:14.520324 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:19:14.521054 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:19:14.571591 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Marking volume 5af74677-0ff1-495e-8304-d139df858d27 as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:19:14.590347 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Copying metadata from snapshot 0ab36a77-45ff-4685-a6ce-2ffb9c4e46bb to 5af74677-0ff1-495e-8304-d139df858d27. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Dec 11 21:19:14.631653 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b6b309-9aa7-44c7-a274-7cc5d825482e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af74677-0ff1-495e-8304-d139df858d27', 'volume_size': 1, 'snapshot_id': '0ab36a77-45ff-4685-a6ce-2ffb9c4e46bb'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:14.633978 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00f03cf-e40a-45e7-bda3-235bf1d3cacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:14.646522 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Volume volume-5af74677-0ff1-495e-8304-d139df858d27 (5af74677-0ff1-495e-8304-d139df858d27): created successfully Dec 11 21:19:14.650106 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00f03cf-e40a-45e7-bda3-235bf1d3cacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:14.653658 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Flow 'volume_create_manager' (9046ddaf-10eb-4085-b923-24cd566bd2bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:19:14.674956 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-85ce01e5-0691-4fd0-a00a-cb195d12cce1 tempest-TestVolumeBootPattern-909971433 None] Created volume successfully. Dec 11 21:19:17.602152 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-59d2d751-8212-4507-b683-1252062c42bb tempest-TestVolumeBootPattern-909971433 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:19:18.317714 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-59d2d751-8212-4507-b683-1252062c42bb tempest-TestVolumeBootPattern-909971433 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.715s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:19:18.318549 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-59d2d751-8212-4507-b683-1252062c42bb tempest-TestVolumeBootPattern-909971433 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5af74677-0ff1-495e-8304-d139df858d27', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '5af74677-0ff1-495e-8304-d139df858d27', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:19:18.345485 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-59d2d751-8212-4507-b683-1252062c42bb tempest-TestVolumeBootPattern-909971433 None] Connection info returned from driver {'name': 'volumes/volume-5af74677-0ff1-495e-8304-d139df858d27', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5af74677-0ff1-495e-8304-d139df858d27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2a6fbebc-641d-47c8-a927-e73fa5b242a8'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:19:18.399569 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-aa720099-3b58-48ee-a865-6f62cb2da12c req-59d2d751-8212-4507-b683-1252062c42bb tempest-TestVolumeBootPattern-909971433 None] attachment_update completed successfully. Dec 11 21:19:20.131399 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:19:20.139201 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:19:20.141114 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:19:20.157968 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Flow 'volume_create_manager' (e8e5a976-2849-4dc6-9132-cc9ce0e67cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:19:20.162300 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a88fa6-1261-4a34-8864-051997f66011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:20.170669 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:19:20.188270 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a88fa6-1261-4a34-8864-051997f66011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-289131190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=08e15870-5cd2-4d69-916b-b7c7e907ddc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7a144477c34942b19e3ae74b12f047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:19:20Z,use_quota=True,user_id='dfaea0b9cfbb455b9e53f4ceb6d1a43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:20.191237 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad0fa76-f235-46d6-8936-4d1a34d47aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:20.198784 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad0fa76-f235-46d6-8936-4d1a34d47aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:20.201768 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bf87b8-a8b3-4376-95c7-a2be2efbde66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:20.204399 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bf87b8-a8b3-4376-95c7-a2be2efbde66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e15870-5cd2-4d69-916b-b7c7e907ddc1', 'volume_name': 'volume-08e15870-5cd2-4d69-916b-b7c7e907ddc1', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:20.206996 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac2609a-93ca-44f3-bb5b-6b854b872b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:20.209180 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac2609a-93ca-44f3-bb5b-6b854b872b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:20.211693 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be90ee6-0c8b-4a9c-98a5-da644bf09a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:20.212681 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Volume 08e15870-5cd2-4d69-916b-b7c7e907ddc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e15870-5cd2-4d69-916b-b7c7e907ddc1', 'volume_size': 1} Dec 11 21:19:20.213092 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] creating volume 'volume-08e15870-5cd2-4d69-916b-b7c7e907ddc1' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:19:20.215047 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:20.316646 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:19:20.317308 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:19:20.319450 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be90ee6-0c8b-4a9c-98a5-da644bf09a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e15870-5cd2-4d69-916b-b7c7e907ddc1', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:20.322122 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090ebeaf-46fd-4c99-a50d-b153097f8d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:20.331076 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Volume volume-08e15870-5cd2-4d69-916b-b7c7e907ddc1 (08e15870-5cd2-4d69-916b-b7c7e907ddc1): created successfully Dec 11 21:19:20.333152 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090ebeaf-46fd-4c99-a50d-b153097f8d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:20.336238 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Flow 'volume_create_manager' (e8e5a976-2849-4dc6-9132-cc9ce0e67cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:19:20.344167 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-424ca4aa-13fa-415c-bfb4-730285a8ea24 tempest-AttachVolumeNegativeTest-1465826611 None] Created volume successfully. Dec 11 21:19:21.893552 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-3e09bc93-d79c-4e37-9ce6-885667b5ca4e req-224be92a-da40-4ef1-b96d-255e3ab04e51 tempest-AttachVolumeNegativeTest-1465826611 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:19:22.687910 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-3e09bc93-d79c-4e37-9ce6-885667b5ca4e req-224be92a-da40-4ef1-b96d-255e3ab04e51 tempest-AttachVolumeNegativeTest-1465826611 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.794s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:19:22.688694 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-3e09bc93-d79c-4e37-9ce6-885667b5ca4e req-224be92a-da40-4ef1-b96d-255e3ab04e51 tempest-AttachVolumeNegativeTest-1465826611 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-08e15870-5cd2-4d69-916b-b7c7e907ddc1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '08e15870-5cd2-4d69-916b-b7c7e907ddc1', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:19:22.713386 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-3e09bc93-d79c-4e37-9ce6-885667b5ca4e req-224be92a-da40-4ef1-b96d-255e3ab04e51 tempest-AttachVolumeNegativeTest-1465826611 None] Connection info returned from driver {'name': 'volumes/volume-08e15870-5cd2-4d69-916b-b7c7e907ddc1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '08e15870-5cd2-4d69-916b-b7c7e907ddc1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b82858c2-d8f0-4950-b28f-2ddf37e9d98f'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:19:22.768963 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-3e09bc93-d79c-4e37-9ce6-885667b5ca4e req-224be92a-da40-4ef1-b96d-255e3ab04e51 tempest-AttachVolumeNegativeTest-1465826611 None] attachment_update completed successfully. Dec 11 21:19:33.184699 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-cddb15c7-7a66-4112-901a-4ad5a0eacb58 req-6da259bf-2128-4721-87e1-287c63c886c8 tempest-TestVolumeBootPattern-909971433 None] Terminate volume connection completed successfully. Dec 11 21:19:33.185274 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-cddb15c7-7a66-4112-901a-4ad5a0eacb58 req-6da259bf-2128-4721-87e1-287c63c886c8 tempest-TestVolumeBootPattern-909971433 None] Deleting attachment 2a6fbebc-641d-47c8-a927-e73fa5b242a8. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:19:33.391559 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-cddb15c7-7a66-4112-901a-4ad5a0eacb58 req-466b5b8e-6b96-4cae-bdd5-c9c536b10aa2 tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-5af74677-0ff1-495e-8304-d139df858d27-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:19:33.437571 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-cddb15c7-7a66-4112-901a-4ad5a0eacb58 req-466b5b8e-6b96-4cae-bdd5-c9c536b10aa2 tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:33.551126 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-cddb15c7-7a66-4112-901a-4ad5a0eacb58 req-466b5b8e-6b96-4cae-bdd5-c9c536b10aa2 tempest-TestVolumeBootPattern-909971433 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:19:33.561501 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-cddb15c7-7a66-4112-901a-4ad5a0eacb58 req-466b5b8e-6b96-4cae-bdd5-c9c536b10aa2 tempest-TestVolumeBootPattern-909971433 None] deleting rbd volume volume-5af74677-0ff1-495e-8304-d139df858d27 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:19:34.093762 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [req-cddb15c7-7a66-4112-901a-4ad5a0eacb58 req-466b5b8e-6b96-4cae-bdd5-c9c536b10aa2 tempest-TestVolumeBootPattern-909971433 None] Created reservations ['e6f2a513-c3ac-4d87-a9db-95ef636a6a68', '3f57dc3e-1fed-4304-838e-691c914c5fa3', '4c403464-5cfa-4948-b64a-cc8d6f0ca566', '6de610c2-3052-4d44-89e1-bce7cea318d6'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:19:34.171852 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-cddb15c7-7a66-4112-901a-4ad5a0eacb58 req-466b5b8e-6b96-4cae-bdd5-c9c536b10aa2 tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:34.225341 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-cddb15c7-7a66-4112-901a-4ad5a0eacb58 req-466b5b8e-6b96-4cae-bdd5-c9c536b10aa2 tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:34.269419 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [req-cddb15c7-7a66-4112-901a-4ad5a0eacb58 req-466b5b8e-6b96-4cae-bdd5-c9c536b10aa2 tempest-TestVolumeBootPattern-909971433 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:19:34.274500 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-cddb15c7-7a66-4112-901a-4ad5a0eacb58 req-466b5b8e-6b96-4cae-bdd5-c9c536b10aa2 tempest-TestVolumeBootPattern-909971433 None] Deleted volume successfully. Dec 11 21:19:34.310123 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-cddb15c7-7a66-4112-901a-4ad5a0eacb58 req-466b5b8e-6b96-4cae-bdd5-c9c536b10aa2 tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-5af74677-0ff1-495e-8304-d139df858d27-delete_volume'" released by "delete_volume" :: held 0.918s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:19:34.592228 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-2bda53eb-8da8-4124-92cd-b827ea3f631b tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-0ab36a77-45ff-4685-a6ce-2ffb9c4e46bb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:19:34.593903 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2bda53eb-8da8-4124-92cd-b827ea3f631b tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:35.819099 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-2bda53eb-8da8-4124-92cd-b827ea3f631b tempest-TestVolumeBootPattern-909971433 None] Created reservations ['de519592-2253-45fb-aee9-f1428f072e46', '62e12680-40a0-4b6c-b833-27caf9251447', '9a863986-9497-4a05-867f-5fed8df3d91a', '3784fc56-c684-4b5b-b06a-5aa85c6a7c68'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:19:35.862914 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-2bda53eb-8da8-4124-92cd-b827ea3f631b tempest-TestVolumeBootPattern-909971433 None] Delete snapshot completed successfully. Dec 11 21:19:35.868201 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-2bda53eb-8da8-4124-92cd-b827ea3f631b tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-0ab36a77-45ff-4685-a6ce-2ffb9c4e46bb-delete_snapshot'" released by "delete_snapshot" :: held 1.276s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:19:36.730323 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-42dbb2f8-a7b9-4499-b251-e493e15a0bfc tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-4930315f-a35d-47e5-816e-622618a3ea5b-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:19:36.793045 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-42dbb2f8-a7b9-4499-b251-e493e15a0bfc tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:36.867833 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-42dbb2f8-a7b9-4499-b251-e493e15a0bfc tempest-TestVolumeBootPattern-909971433 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:19:36.876407 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-42dbb2f8-a7b9-4499-b251-e493e15a0bfc tempest-TestVolumeBootPattern-909971433 None] deleting rbd volume volume-4930315f-a35d-47e5-816e-622618a3ea5b {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:19:37.119997 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-42dbb2f8-a7b9-4499-b251-e493e15a0bfc tempest-TestVolumeBootPattern-909971433 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:19:37.172900 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-42dbb2f8-a7b9-4499-b251-e493e15a0bfc tempest-TestVolumeBootPattern-909971433 None] deleting parent snapshot volume-4930315f-a35d-47e5-816e-622618a3ea5b.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:19:37.903323 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-42dbb2f8-a7b9-4499-b251-e493e15a0bfc tempest-TestVolumeBootPattern-909971433 None] Created reservations ['5662aa50-8054-4ac7-94f9-2c62fcd83665', 'e4353860-fbd8-453d-87b3-43f01dae2cb5', 'bc0963f3-91c0-4c24-ae5d-88b8d0955bf8', '129fde47-6884-4881-aff9-1128d64958bf'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:19:37.977443 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-42dbb2f8-a7b9-4499-b251-e493e15a0bfc tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:38.036299 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-42dbb2f8-a7b9-4499-b251-e493e15a0bfc tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:38.111017 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-42dbb2f8-a7b9-4499-b251-e493e15a0bfc tempest-TestVolumeBootPattern-909971433 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:19:38.116520 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-42dbb2f8-a7b9-4499-b251-e493e15a0bfc tempest-TestVolumeBootPattern-909971433 None] Deleted volume successfully. Dec 11 21:19:38.138461 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-42dbb2f8-a7b9-4499-b251-e493e15a0bfc tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-4930315f-a35d-47e5-816e-622618a3ea5b-delete_volume'" released by "delete_volume" :: held 1.408s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:19:38.788467 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-3a7d65b3-9ba6-4713-aaa3-d1159ca95210 req-e33b5d04-a34a-4022-934c-95725e5704a1 tempest-AttachVolumeNegativeTest-1465826611 None] Terminate volume connection completed successfully. Dec 11 21:19:38.789219 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-3a7d65b3-9ba6-4713-aaa3-d1159ca95210 req-e33b5d04-a34a-4022-934c-95725e5704a1 tempest-AttachVolumeNegativeTest-1465826611 None] Deleting attachment b82858c2-d8f0-4950-b28f-2ddf37e9d98f. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:19:39.602329 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:19:39.606138 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:19:39.606659 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:19:39.619509 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Flow 'volume_create_manager' (e40aa5af-5375-46eb-843e-f62c54c738c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:19:39.622941 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66398858-ca1b-4434-b9f6-598d3ddcda23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:39.630111 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:19:39.645472 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66398858-ca1b-4434-b9f6-598d3ddcda23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-174428003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=de4f48ae-e75d-442f-bb31-a458213e7d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f0381bbbd84752abdbd2d9ae843b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:19:40Z,use_quota=True,user_id='8b579ede23eb483b89f94f8e1696a638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:39.648477 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c52c61-0a7c-45e8-82bc-65fe8cfa4db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:39.651695 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c52c61-0a7c-45e8-82bc-65fe8cfa4db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:39.655043 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f5ef02-d601-4279-972c-57d6a37bc1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:39.741873 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f5ef02-d601-4279-972c-57d6a37bc1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de4f48ae-e75d-442f-bb31-a458213e7d85', 'volume_name': 'volume-de4f48ae-e75d-442f-bb31-a458213e7d85', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:39.744894 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f371a28-88a7-4283-a8fc-ac6c60cd14cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:39.747469 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f371a28-88a7-4283-a8fc-ac6c60cd14cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:39.749817 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49cd09e-1917-4c0e-b982-851c1b919f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:39.751143 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Volume de4f48ae-e75d-442f-bb31-a458213e7d85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de4f48ae-e75d-442f-bb31-a458213e7d85', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 21:19:39.751959 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Cloning de4f48ae-e75d-442f-bb31-a458213e7d85 from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 21:19:39.763904 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:19:39.774526 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 19, 39, 768648)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:19:39.774914 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:19:39.775923 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 21:19:39.780941 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:19:39.781846 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 21:19:39.788150 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 19, 39, 785386)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:19:39.788819 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:19:39.789211 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 21:19:39.801004 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:39.886753 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] creating snapshot='volume-de4f48ae-e75d-442f-bb31-a458213e7d85.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:19:40.839810 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-de4f48ae-e75d-442f-bb31-a458213e7d85.clone_snap' to 'volume-de4f48ae-e75d-442f-bb31-a458213e7d85' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:19:41.020566 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:19:41.026799 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:19:41.027544 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:19:41.059218 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:19:41.059991 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Marking volume de4f48ae-e75d-442f-bb31-a458213e7d85 as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:19:41.076344 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to de4f48ae-e75d-442f-bb31-a458213e7d85. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 21:19:41.078071 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Creating volume glance metadata for volume de4f48ae-e75d-442f-bb31-a458213e7d85 backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 21:19:41.170393 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49cd09e-1917-4c0e-b982-851c1b919f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4f48ae-e75d-442f-bb31-a458213e7d85', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:41.173970 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe669c9-92bf-4c8a-9eef-130983350241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:41.183201 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Volume volume-de4f48ae-e75d-442f-bb31-a458213e7d85 (de4f48ae-e75d-442f-bb31-a458213e7d85): created successfully Dec 11 21:19:41.185943 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe669c9-92bf-4c8a-9eef-130983350241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:41.189203 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Flow 'volume_create_manager' (e40aa5af-5375-46eb-843e-f62c54c738c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:19:41.201276 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-844b73d3-461e-4f2b-a589-286e6617a9de tempest-TestVolumeBootPattern-909971433 None] Created volume successfully. Dec 11 21:19:44.989512 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-fa7cba0d-9989-4672-bc20-6967cbf5fca9 req-941f908f-d159-4df8-9dd4-275e5388c213 tempest-TestVolumeBootPattern-909971433 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:19:45.756106 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-fa7cba0d-9989-4672-bc20-6967cbf5fca9 req-941f908f-d159-4df8-9dd4-275e5388c213 tempest-TestVolumeBootPattern-909971433 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.766s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:19:45.757624 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-fa7cba0d-9989-4672-bc20-6967cbf5fca9 req-941f908f-d159-4df8-9dd4-275e5388c213 tempest-TestVolumeBootPattern-909971433 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-de4f48ae-e75d-442f-bb31-a458213e7d85', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'de4f48ae-e75d-442f-bb31-a458213e7d85', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:19:45.783930 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-fa7cba0d-9989-4672-bc20-6967cbf5fca9 req-941f908f-d159-4df8-9dd4-275e5388c213 tempest-TestVolumeBootPattern-909971433 None] Connection info returned from driver {'name': 'volumes/volume-de4f48ae-e75d-442f-bb31-a458213e7d85', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'de4f48ae-e75d-442f-bb31-a458213e7d85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4c87e43e-bec9-4a0a-884e-dd41cdaacf07'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:19:45.841128 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-fa7cba0d-9989-4672-bc20-6967cbf5fca9 req-941f908f-d159-4df8-9dd4-275e5388c213 tempest-TestVolumeBootPattern-909971433 None] attachment_update completed successfully. Dec 11 21:19:54.823966 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:19:54.828112 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:19:54.828611 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:19:54.842942 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Flow 'volume_create_manager' (18a0fe82-25ea-4543-b5dc-dbb2e1acd473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:19:54.846557 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523ea5d4-a702-4bef-a3d9-87bfdafcb332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:54.853707 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:19:54.866025 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523ea5d4-a702-4bef-a3d9-87bfdafcb332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2004327241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e1be6716-6919-4e02-b766-ee81bbe16518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7a144477c34942b19e3ae74b12f047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:19:55Z,use_quota=True,user_id='dfaea0b9cfbb455b9e53f4ceb6d1a43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:54.868751 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc1d92f-d58a-4944-a402-26a096cb439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:54.870949 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc1d92f-d58a-4944-a402-26a096cb439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:54.873379 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649aa707-042b-42ae-82b6-736b80a6acc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:54.875686 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649aa707-042b-42ae-82b6-736b80a6acc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1be6716-6919-4e02-b766-ee81bbe16518', 'volume_name': 'volume-e1be6716-6919-4e02-b766-ee81bbe16518', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:54.878022 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8993a94a-7b51-44db-b1d4-6578dd441844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:54.880205 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8993a94a-7b51-44db-b1d4-6578dd441844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:54.882424 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863afcc3-fe8a-4765-af3a-dc95500860c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:54.883229 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Volume e1be6716-6919-4e02-b766-ee81bbe16518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1be6716-6919-4e02-b766-ee81bbe16518', 'volume_size': 1} Dec 11 21:19:54.883629 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] creating volume 'volume-e1be6716-6919-4e02-b766-ee81bbe16518' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:19:54.884735 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:54.945390 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:19:54.945884 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:19:54.948156 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863afcc3-fe8a-4765-af3a-dc95500860c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1be6716-6919-4e02-b766-ee81bbe16518', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:54.950468 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d02697-718c-426b-aec6-6d4655fa21ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:19:54.959503 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Volume volume-e1be6716-6919-4e02-b766-ee81bbe16518 (e1be6716-6919-4e02-b766-ee81bbe16518): created successfully Dec 11 21:19:54.961615 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d02697-718c-426b-aec6-6d4655fa21ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:19:54.965230 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Flow 'volume_create_manager' (18a0fe82-25ea-4543-b5dc-dbb2e1acd473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:19:54.972894 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-067c2cdd-d8e4-4ec8-b86b-980865ecfed5 tempest-AttachVolumeNegativeTest-1465826611 None] Created volume successfully. Dec 11 21:19:55.845117 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:19:55.846138 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:55.889919 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:55.929801 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:19:56.311923 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-0c5d95fc-60c3-4a60-8f62-65a769c1716f req-5453e4a5-008b-4e79-81b8-7bdbed34cafd tempest-AttachVolumeNegativeTest-1465826611 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:19:57.026002 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-0c5d95fc-60c3-4a60-8f62-65a769c1716f req-5453e4a5-008b-4e79-81b8-7bdbed34cafd tempest-AttachVolumeNegativeTest-1465826611 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.713s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:19:57.030233 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-0c5d95fc-60c3-4a60-8f62-65a769c1716f req-5453e4a5-008b-4e79-81b8-7bdbed34cafd tempest-AttachVolumeNegativeTest-1465826611 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e1be6716-6919-4e02-b766-ee81bbe16518', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'e1be6716-6919-4e02-b766-ee81bbe16518', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:19:57.081838 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-0c5d95fc-60c3-4a60-8f62-65a769c1716f req-5453e4a5-008b-4e79-81b8-7bdbed34cafd tempest-AttachVolumeNegativeTest-1465826611 None] Connection info returned from driver {'name': 'volumes/volume-e1be6716-6919-4e02-b766-ee81bbe16518', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e1be6716-6919-4e02-b766-ee81bbe16518', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '704bc559-7797-4f09-838a-5b9997644f09'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:19:57.086778 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-9845f988-60b3-4856-9a47-80ddf8de86d3 req-6f636b26-acd1-4468-b6b3-7dbc0e799f2e tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:19:57.251150 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-0c5d95fc-60c3-4a60-8f62-65a769c1716f req-5453e4a5-008b-4e79-81b8-7bdbed34cafd tempest-AttachVolumeNegativeTest-1465826611 None] attachment_update completed successfully. Dec 11 21:19:57.846308 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-9845f988-60b3-4856-9a47-80ddf8de86d3 req-6f636b26-acd1-4468-b6b3-7dbc0e799f2e tempest-TestVolumeBootPattern-909971433 None] Create snapshot completed successfully Dec 11 21:20:00.710973 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-0ffe09b6-0fd2-46ff-924b-5f7ebd4f34ec req-c146c8ce-0e54-48f1-9407-405980c2a24f tempest-AttachVolumeNegativeTest-1465826611 None] Terminate volume connection completed successfully. Dec 11 21:20:00.711653 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-0ffe09b6-0fd2-46ff-924b-5f7ebd4f34ec req-c146c8ce-0e54-48f1-9407-405980c2a24f tempest-AttachVolumeNegativeTest-1465826611 None] Deleting attachment 704bc559-7797-4f09-838a-5b9997644f09. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:20:01.423923 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:20:01.428156 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:20:01.428649 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:20:01.452152 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Flow 'volume_create_manager' (663c9bc8-684a-464f-b3b2-21f58e77211c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:20:01.455648 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb961f68-231c-42da-8d89-0f11ed55b10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:01.462735 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:20:01.475824 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb961f68-231c-42da-8d89-0f11ed55b10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:20:01Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0185cfe3-743b-4efa-a9d0-db104d5391c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f0381bbbd84752abdbd2d9ae843b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a3ed6062-9235-41cc-8be3-469449fbeed3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:20:01Z,use_quota=True,user_id='8b579ede23eb483b89f94f8e1696a638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:01.479093 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29643ca7-062b-4990-a396-432328b11df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:01.481360 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29643ca7-062b-4990-a396-432328b11df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:01.484019 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee0ccf7-e06f-4338-8a7e-69c72048cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:01.486290 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee0ccf7-e06f-4338-8a7e-69c72048cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0185cfe3-743b-4efa-a9d0-db104d5391c4', 'volume_name': 'volume-0185cfe3-743b-4efa-a9d0-db104d5391c4', 'volume_size': 1, 'snapshot_id': 'a3ed6062-9235-41cc-8be3-469449fbeed3'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:01.489130 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded1fd57-8fe4-4ddd-81f4-91cb3bca8310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:01.491572 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded1fd57-8fe4-4ddd-81f4-91cb3bca8310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:01.494548 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866e59c8-7b2b-4a66-9628-7228c0ed7b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:01.495352 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Volume 0185cfe3-743b-4efa-a9d0-db104d5391c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0185cfe3-743b-4efa-a9d0-db104d5391c4', 'volume_size': 1, 'snapshot_id': 'a3ed6062-9235-41cc-8be3-469449fbeed3'} Dec 11 21:20:01.516299 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] cloning volumes/volume-de4f48ae-e75d-442f-bb31-a458213e7d85@snapshot-a3ed6062-9235-41cc-8be3-469449fbeed3 to volume-0185cfe3-743b-4efa-a9d0-db104d5391c4 {{(pid=134173) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 11 21:20:01.517237 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:01.581830 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:01.730678 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:20:01.731239 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:20:01.751180 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Marking volume 0185cfe3-743b-4efa-a9d0-db104d5391c4 as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:20:01.758620 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Copying metadata from snapshot a3ed6062-9235-41cc-8be3-469449fbeed3 to 0185cfe3-743b-4efa-a9d0-db104d5391c4. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Dec 11 21:20:01.801952 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866e59c8-7b2b-4a66-9628-7228c0ed7b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0185cfe3-743b-4efa-a9d0-db104d5391c4', 'volume_size': 1, 'snapshot_id': 'a3ed6062-9235-41cc-8be3-469449fbeed3'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:01.804931 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026b7bea-1fc2-4975-94c0-390ff3bbe5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:01.818114 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Volume volume-0185cfe3-743b-4efa-a9d0-db104d5391c4 (0185cfe3-743b-4efa-a9d0-db104d5391c4): created successfully Dec 11 21:20:01.821403 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026b7bea-1fc2-4975-94c0-390ff3bbe5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:01.825506 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Flow 'volume_create_manager' (663c9bc8-684a-464f-b3b2-21f58e77211c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:20:01.855461 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-ba3eb342-c132-406e-84e7-4aa94486584e tempest-TestVolumeBootPattern-909971433 None] Created volume successfully. Dec 11 21:20:04.817890 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-294f9a69-27f8-4552-882e-3272965df6d9 tempest-TestVolumeBootPattern-909971433 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:20:05.581919 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-294f9a69-27f8-4552-882e-3272965df6d9 tempest-TestVolumeBootPattern-909971433 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.764s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:20:05.584198 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-294f9a69-27f8-4552-882e-3272965df6d9 tempest-TestVolumeBootPattern-909971433 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0185cfe3-743b-4efa-a9d0-db104d5391c4', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '0185cfe3-743b-4efa-a9d0-db104d5391c4', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:20:05.613409 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-294f9a69-27f8-4552-882e-3272965df6d9 tempest-TestVolumeBootPattern-909971433 None] Connection info returned from driver {'name': 'volumes/volume-0185cfe3-743b-4efa-a9d0-db104d5391c4', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0185cfe3-743b-4efa-a9d0-db104d5391c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c5ee7063-3063-4b93-be67-5de0817cc852'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:20:05.662839 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-39289fa6-8bbe-4e3e-a29b-01a65eb60b50 req-294f9a69-27f8-4552-882e-3272965df6d9 tempest-TestVolumeBootPattern-909971433 None] attachment_update completed successfully. Dec 11 21:20:08.238940 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:20:08.242749 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:20:08.243344 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:20:08.256496 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Flow 'volume_create_manager' (d0f490ba-c4cb-48b8-8f7a-1de132d45745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:20:08.261232 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d24c87-fb71-4b0c-b462-9ded3a59c63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:08.267349 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:20:08.281331 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d24c87-fb71-4b0c-b462-9ded3a59c63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1190068916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fa67892d8545d58a0fcb45ab34497f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:20:08Z,use_quota=True,user_id='47b5d352d7ec40b5b88539a24a3acaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:08.284155 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ecf92d-217b-4a1f-9170-9d37f9eff32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:08.286428 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ecf92d-217b-4a1f-9170-9d37f9eff32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:08.288884 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a42f56e-1d0a-4f67-95f2-4fe57591e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:08.291276 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a42f56e-1d0a-4f67-95f2-4fe57591e338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66', 'volume_name': 'volume-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:08.293596 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaec90a-f121-4448-990c-509363e3147f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:08.295833 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaec90a-f121-4448-990c-509363e3147f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:08.298088 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fba06ca-ac41-4aaf-ad6d-305fbf1cf1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:08.298905 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Volume 0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66', 'volume_size': 1} Dec 11 21:20:08.299307 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] creating volume 'volume-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:20:08.300449 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:08.358619 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:20:08.359000 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:20:08.361113 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fba06ca-ac41-4aaf-ad6d-305fbf1cf1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:08.363443 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c47f0c-1ffd-42b7-a352-a82f4c18399c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:08.372433 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Volume volume-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66 (0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66): created successfully Dec 11 21:20:08.374277 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c47f0c-1ffd-42b7-a352-a82f4c18399c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:08.377359 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Flow 'volume_create_manager' (d0f490ba-c4cb-48b8-8f7a-1de132d45745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:20:08.385825 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-94aca4e9-8f36-4ff1-b1a3-f92a4ad3a8c6 tempest-VolumesActionsTest-1114221274 None] Created volume successfully. Dec 11 21:20:13.987209 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:20:13.990687 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:20:13.991133 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:20:14.003490 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Flow 'volume_create_manager' (f6950937-78e5-41ad-ba2f-a27bcd34af6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:20:14.008006 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488238ed-34ef-4a07-bc98-88df2afa8525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:14.014217 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:20:14.027811 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488238ed-34ef-4a07-bc98-88df2afa8525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1076375243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7d290b0a-05d8-4750-aef6-9132080bc747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7a144477c34942b19e3ae74b12f047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:20:14Z,use_quota=True,user_id='dfaea0b9cfbb455b9e53f4ceb6d1a43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:14.030457 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (317574b6-1b43-4b2f-bdb3-60505439aa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:14.032761 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (317574b6-1b43-4b2f-bdb3-60505439aa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:14.035256 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc3f2d7-cb2a-41dc-86a8-f7fcbd82f865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:14.037542 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc3f2d7-cb2a-41dc-86a8-f7fcbd82f865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d290b0a-05d8-4750-aef6-9132080bc747', 'volume_name': 'volume-7d290b0a-05d8-4750-aef6-9132080bc747', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:14.040465 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e382bae9-7ccd-4a84-9b24-aeb6fb288eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:14.042655 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e382bae9-7ccd-4a84-9b24-aeb6fb288eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:14.044909 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e98fe59-8e8c-4fdb-85f6-d0a094b1a758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:14.045906 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Volume 7d290b0a-05d8-4750-aef6-9132080bc747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d290b0a-05d8-4750-aef6-9132080bc747', 'volume_size': 1} Dec 11 21:20:14.046608 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] creating volume 'volume-7d290b0a-05d8-4750-aef6-9132080bc747' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:20:14.047911 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:14.100147 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:20:14.100518 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:20:14.103116 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e98fe59-8e8c-4fdb-85f6-d0a094b1a758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d290b0a-05d8-4750-aef6-9132080bc747', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:14.105294 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32947ea-fb4e-4fb1-bbc0-29c4f4d9505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:20:14.113813 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Volume volume-7d290b0a-05d8-4750-aef6-9132080bc747 (7d290b0a-05d8-4750-aef6-9132080bc747): created successfully Dec 11 21:20:14.115687 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32947ea-fb4e-4fb1-bbc0-29c4f4d9505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:20:14.119327 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Flow 'volume_create_manager' (f6950937-78e5-41ad-ba2f-a27bcd34af6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:20:14.127054 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-fe43f5ac-7378-45e5-a9ed-c1500152c5ba tempest-AttachVolumeNegativeTest-1465826611 None] Created volume successfully. Dec 11 21:20:15.459476 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-466d89ab-5087-461c-adef-d86768c83fa8 req-96b9c46a-6e67-4a2e-a348-2ed81adb41c9 tempest-AttachVolumeNegativeTest-1465826611 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:20:16.170344 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-466d89ab-5087-461c-adef-d86768c83fa8 req-96b9c46a-6e67-4a2e-a348-2ed81adb41c9 tempest-AttachVolumeNegativeTest-1465826611 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.711s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:20:16.171232 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-466d89ab-5087-461c-adef-d86768c83fa8 req-96b9c46a-6e67-4a2e-a348-2ed81adb41c9 tempest-AttachVolumeNegativeTest-1465826611 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7d290b0a-05d8-4750-aef6-9132080bc747', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '7d290b0a-05d8-4750-aef6-9132080bc747', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:20:16.193372 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-466d89ab-5087-461c-adef-d86768c83fa8 req-96b9c46a-6e67-4a2e-a348-2ed81adb41c9 tempest-AttachVolumeNegativeTest-1465826611 None] Connection info returned from driver {'name': 'volumes/volume-7d290b0a-05d8-4750-aef6-9132080bc747', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7d290b0a-05d8-4750-aef6-9132080bc747', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '83dacb5f-de11-4303-a98e-091f1509b3c1'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:20:16.237712 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-466d89ab-5087-461c-adef-d86768c83fa8 req-96b9c46a-6e67-4a2e-a348-2ed81adb41c9 tempest-AttachVolumeNegativeTest-1465826611 None] attachment_update completed successfully. Dec 11 21:20:18.218372 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-2137987b-0ad2-45c7-b187-1e72774f17b0 req-1c3a1556-a37c-4bcb-9bc4-6b35bf59681b tempest-TestVolumeBootPattern-909971433 None] Terminate volume connection completed successfully. Dec 11 21:20:18.219054 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-2137987b-0ad2-45c7-b187-1e72774f17b0 req-1c3a1556-a37c-4bcb-9bc4-6b35bf59681b tempest-TestVolumeBootPattern-909971433 None] Deleting attachment c5ee7063-3063-4b93-be67-5de0817cc852. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:20:18.346572 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-2137987b-0ad2-45c7-b187-1e72774f17b0 req-b2f56b7c-0c22-4711-8221-b317cd94ff14 tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-0185cfe3-743b-4efa-a9d0-db104d5391c4-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:20:18.384525 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-2137987b-0ad2-45c7-b187-1e72774f17b0 req-b2f56b7c-0c22-4711-8221-b317cd94ff14 tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:18.550693 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-2137987b-0ad2-45c7-b187-1e72774f17b0 req-b2f56b7c-0c22-4711-8221-b317cd94ff14 tempest-TestVolumeBootPattern-909971433 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:20:18.563873 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-2137987b-0ad2-45c7-b187-1e72774f17b0 req-b2f56b7c-0c22-4711-8221-b317cd94ff14 tempest-TestVolumeBootPattern-909971433 None] deleting rbd volume volume-0185cfe3-743b-4efa-a9d0-db104d5391c4 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:20:18.837717 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [req-2137987b-0ad2-45c7-b187-1e72774f17b0 req-b2f56b7c-0c22-4711-8221-b317cd94ff14 tempest-TestVolumeBootPattern-909971433 None] Created reservations ['a5e71092-e5f4-4bd1-a369-7245d4cd97bd', 'a587f561-c94c-4b83-bcf5-30198b64f554', 'c88289ec-d6ea-45af-9b94-3f00aa2d9909', 'f987408f-a712-4ba0-9b42-cc8551cb3ec7'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:20:18.885966 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-2137987b-0ad2-45c7-b187-1e72774f17b0 req-b2f56b7c-0c22-4711-8221-b317cd94ff14 tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:18.931855 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-2137987b-0ad2-45c7-b187-1e72774f17b0 req-b2f56b7c-0c22-4711-8221-b317cd94ff14 tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:18.968903 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [req-2137987b-0ad2-45c7-b187-1e72774f17b0 req-b2f56b7c-0c22-4711-8221-b317cd94ff14 tempest-TestVolumeBootPattern-909971433 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:20:18.975232 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-2137987b-0ad2-45c7-b187-1e72774f17b0 req-b2f56b7c-0c22-4711-8221-b317cd94ff14 tempest-TestVolumeBootPattern-909971433 None] Deleted volume successfully. Dec 11 21:20:19.000550 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-2137987b-0ad2-45c7-b187-1e72774f17b0 req-b2f56b7c-0c22-4711-8221-b317cd94ff14 tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-0185cfe3-743b-4efa-a9d0-db104d5391c4-delete_volume'" released by "delete_volume" :: held 0.654s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:20:19.355405 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-aa973ecb-9a74-4c37-bb16-27a13363a006 tempest-VolumesActionsTest-1114221274 None] Lock "b'cinder-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66'" acquired by "attach_volume" :: waited 0.009s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:20:19.393207 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-aa973ecb-9a74-4c37-bb16-27a13363a006 tempest-VolumesActionsTest-1114221274 None] Attaching volume 0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66 to instance 4adde6c8-3d14-41b5-a680-662bc744afbf at mountpoint /dev/sdb on host None. Dec 11 21:20:19.420861 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-aa973ecb-9a74-4c37-bb16-27a13363a006 tempest-VolumesActionsTest-1114221274 None] Attach volume completed successfully. Dec 11 21:20:19.432920 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-aa973ecb-9a74-4c37-bb16-27a13363a006 tempest-VolumesActionsTest-1114221274 None] Lock "b'cinder-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66'" released by "attach_volume" :: held 0.078s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:20:19.549223 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-d8df98ec-382c-47a8-9e63-55b5bee6790f req-785ddd12-540d-4bb4-a881-e7bd33cc71b6 tempest-AttachVolumeNegativeTest-1465826611 None] Terminate volume connection completed successfully. Dec 11 21:20:19.549711 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-d8df98ec-382c-47a8-9e63-55b5bee6790f req-785ddd12-540d-4bb4-a881-e7bd33cc71b6 tempest-AttachVolumeNegativeTest-1465826611 None] Deleting attachment 83dacb5f-de11-4303-a98e-091f1509b3c1. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:20:19.557014 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d827639a-9d8a-4772-864c-81556107ce88 tempest-VolumesActionsTest-1114221274 None] Lock "b'cinder-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66-detach_volume'" acquired by "detach_volume" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:20:19.557516 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d827639a-9d8a-4772-864c-81556107ce88 tempest-VolumesActionsTest-1114221274 None] Detaching volume 0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66 from instance 4adde6c8-3d14-41b5-a680-662bc744afbf. Dec 11 21:20:19.594319 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d827639a-9d8a-4772-864c-81556107ce88 tempest-VolumesActionsTest-1114221274 None] Detach volume completed successfully. Dec 11 21:20:19.600209 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d827639a-9d8a-4772-864c-81556107ce88 tempest-VolumesActionsTest-1114221274 None] Lock "b'cinder-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66-detach_volume'" released by "detach_volume" :: held 0.042s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:20:19.709266 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-e04034c6-bbcd-4259-b42a-9e9d3e0cc0f1 tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-a3ed6062-9235-41cc-8be3-469449fbeed3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:20:19.710936 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e04034c6-bbcd-4259-b42a-9e9d3e0cc0f1 tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:20.125671 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-13feda07-70ed-41ee-b8a7-def48bf2f70e tempest-AttachVolumeNegativeTest-1465826611 None] Lock "b'cinder-7d290b0a-05d8-4750-aef6-9132080bc747-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:20:20.159809 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13feda07-70ed-41ee-b8a7-def48bf2f70e tempest-AttachVolumeNegativeTest-1465826611 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:20.210792 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13feda07-70ed-41ee-b8a7-def48bf2f70e tempest-AttachVolumeNegativeTest-1465826611 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:20:20.211954 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13feda07-70ed-41ee-b8a7-def48bf2f70e tempest-AttachVolumeNegativeTest-1465826611 None] Volume volume-7d290b0a-05d8-4750-aef6-9132080bc747 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:20:20.219504 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13feda07-70ed-41ee-b8a7-def48bf2f70e tempest-AttachVolumeNegativeTest-1465826611 None] deleting rbd volume volume-7d290b0a-05d8-4750-aef6-9132080bc747 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:20:20.448863 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-13feda07-70ed-41ee-b8a7-def48bf2f70e tempest-AttachVolumeNegativeTest-1465826611 None] Created reservations ['f02a0129-f91e-4e5d-b798-46568abfcef0', '51c9a3b3-46e0-43af-bd0c-cc024b13412d', '60c3a9a1-dc20-438a-9292-94868f4262e0', '26311827-b18f-4303-a489-177f9da42a2e'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:20:20.488711 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13feda07-70ed-41ee-b8a7-def48bf2f70e tempest-AttachVolumeNegativeTest-1465826611 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:20.511926 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13feda07-70ed-41ee-b8a7-def48bf2f70e tempest-AttachVolumeNegativeTest-1465826611 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:20.533755 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-13feda07-70ed-41ee-b8a7-def48bf2f70e tempest-AttachVolumeNegativeTest-1465826611 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:20:20.537723 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-13feda07-70ed-41ee-b8a7-def48bf2f70e tempest-AttachVolumeNegativeTest-1465826611 None] Deleted volume successfully. Dec 11 21:20:20.549617 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-13feda07-70ed-41ee-b8a7-def48bf2f70e tempest-AttachVolumeNegativeTest-1465826611 None] Lock "b'cinder-7d290b0a-05d8-4750-aef6-9132080bc747-delete_volume'" released by "delete_volume" :: held 0.424s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:20:24.944208 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-4345e1ea-c08c-4421-a9b2-44002d9b7168 tempest-AttachVolumeNegativeTest-1465826611 None] Lock "b'cinder-e1be6716-6919-4e02-b766-ee81bbe16518-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:20:25.014902 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4345e1ea-c08c-4421-a9b2-44002d9b7168 tempest-AttachVolumeNegativeTest-1465826611 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:25.065075 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4345e1ea-c08c-4421-a9b2-44002d9b7168 tempest-AttachVolumeNegativeTest-1465826611 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:20:25.065607 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4345e1ea-c08c-4421-a9b2-44002d9b7168 tempest-AttachVolumeNegativeTest-1465826611 None] Volume volume-e1be6716-6919-4e02-b766-ee81bbe16518 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:20:25.075265 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4345e1ea-c08c-4421-a9b2-44002d9b7168 tempest-AttachVolumeNegativeTest-1465826611 None] deleting rbd volume volume-e1be6716-6919-4e02-b766-ee81bbe16518 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:20:25.423942 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-4345e1ea-c08c-4421-a9b2-44002d9b7168 tempest-AttachVolumeNegativeTest-1465826611 None] Created reservations ['58a73724-ef01-4e42-bb70-079e3e301964', 'ea274981-e997-4196-9e08-140859fe87d1', '4b23b80d-9347-4777-9e73-95db65b62148', '79a73c96-cd9c-4ff5-ab57-eb351e026b66'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:20:25.473895 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4345e1ea-c08c-4421-a9b2-44002d9b7168 tempest-AttachVolumeNegativeTest-1465826611 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:25.501462 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4345e1ea-c08c-4421-a9b2-44002d9b7168 tempest-AttachVolumeNegativeTest-1465826611 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:25.542703 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-4345e1ea-c08c-4421-a9b2-44002d9b7168 tempest-AttachVolumeNegativeTest-1465826611 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:20:25.548404 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4345e1ea-c08c-4421-a9b2-44002d9b7168 tempest-AttachVolumeNegativeTest-1465826611 None] Deleted volume successfully. Dec 11 21:20:25.563562 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-4345e1ea-c08c-4421-a9b2-44002d9b7168 tempest-AttachVolumeNegativeTest-1465826611 None] Lock "b'cinder-e1be6716-6919-4e02-b766-ee81bbe16518-delete_volume'" released by "delete_volume" :: held 0.619s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:20:33.591380 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-45251a87-ecb4-4a6b-84c6-d2b079427e01 tempest-AttachVolumeNegativeTest-1465826611 None] Lock "b'cinder-08e15870-5cd2-4d69-916b-b7c7e907ddc1-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:20:33.626237 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-45251a87-ecb4-4a6b-84c6-d2b079427e01 tempest-AttachVolumeNegativeTest-1465826611 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:33.671956 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-45251a87-ecb4-4a6b-84c6-d2b079427e01 tempest-AttachVolumeNegativeTest-1465826611 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:20:33.672405 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-45251a87-ecb4-4a6b-84c6-d2b079427e01 tempest-AttachVolumeNegativeTest-1465826611 None] Volume volume-08e15870-5cd2-4d69-916b-b7c7e907ddc1 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:20:33.681235 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-45251a87-ecb4-4a6b-84c6-d2b079427e01 tempest-AttachVolumeNegativeTest-1465826611 None] deleting rbd volume volume-08e15870-5cd2-4d69-916b-b7c7e907ddc1 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:20:33.696500 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-49f590fc-4382-4a8a-a7ef-2c1e74d97d7e tempest-VolumesActionsTest-1114221274 None] Lock "b'cinder-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66'" acquired by "attach_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:20:33.739013 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-49f590fc-4382-4a8a-a7ef-2c1e74d97d7e tempest-VolumesActionsTest-1114221274 None] Attaching volume 0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66 to instance 0eea8805-13bf-44d3-8518-6104e4dbe0d3 at mountpoint /dev/sdb on host None. Dec 11 21:20:33.763456 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-49f590fc-4382-4a8a-a7ef-2c1e74d97d7e tempest-VolumesActionsTest-1114221274 None] Attach volume completed successfully. Dec 11 21:20:33.768808 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-49f590fc-4382-4a8a-a7ef-2c1e74d97d7e tempest-VolumesActionsTest-1114221274 None] Lock "b'cinder-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66'" released by "attach_volume" :: held 0.072s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:20:33.953826 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-bccb9134-5130-4a9b-bc25-08ef34358f99 tempest-VolumesActionsTest-1114221274 None] Lock "b'cinder-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66-detach_volume'" acquired by "detach_volume" :: waited 0.019s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:20:33.954294 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-bccb9134-5130-4a9b-bc25-08ef34358f99 tempest-VolumesActionsTest-1114221274 None] Detaching volume 0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66 from instance 0eea8805-13bf-44d3-8518-6104e4dbe0d3. Dec 11 21:20:33.995680 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-45251a87-ecb4-4a6b-84c6-d2b079427e01 tempest-AttachVolumeNegativeTest-1465826611 None] Created reservations ['6b354f2e-eecf-4337-bfc7-33c6cbe4c4e0', 'f0a8bcf2-36bb-4500-8168-d38444ef9538', 'b1b5086c-07b3-4ef8-86e6-ca4cb478ddf7', '0e29cd03-118f-4ce9-a3ac-ca8087dee09d'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:20:34.030360 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-bccb9134-5130-4a9b-bc25-08ef34358f99 tempest-VolumesActionsTest-1114221274 None] Detach volume completed successfully. Dec 11 21:20:34.040139 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-bccb9134-5130-4a9b-bc25-08ef34358f99 tempest-VolumesActionsTest-1114221274 None] Lock "b'cinder-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66-detach_volume'" released by "detach_volume" :: held 0.086s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:20:34.058284 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-45251a87-ecb4-4a6b-84c6-d2b079427e01 tempest-AttachVolumeNegativeTest-1465826611 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:34.092498 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-45251a87-ecb4-4a6b-84c6-d2b079427e01 tempest-AttachVolumeNegativeTest-1465826611 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:34.129644 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-45251a87-ecb4-4a6b-84c6-d2b079427e01 tempest-AttachVolumeNegativeTest-1465826611 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:20:34.144071 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-45251a87-ecb4-4a6b-84c6-d2b079427e01 tempest-AttachVolumeNegativeTest-1465826611 None] Deleted volume successfully. Dec 11 21:20:34.159378 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-45251a87-ecb4-4a6b-84c6-d2b079427e01 tempest-AttachVolumeNegativeTest-1465826611 None] Lock "b'cinder-08e15870-5cd2-4d69-916b-b7c7e907ddc1-delete_volume'" released by "delete_volume" :: held 0.568s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:20:38.922680 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-91459980-b961-40f8-a543-70cf6e1256a9 tempest-VolumesActionsTest-1114221274 None] Running cmd (subprocess): rbd export --pool volumes volume-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66 /opt/stack/data/cinder/conversion/volume-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66-4dacf46f-19f4-40fd-a9f1-9ba2a850a3e8 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:20:39.688580 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-91459980-b961-40f8-a543-70cf6e1256a9 tempest-VolumesActionsTest-1114221274 None] CMD "rbd export --pool volumes volume-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66 /opt/stack/data/cinder/conversion/volume-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66-4dacf46f-19f4-40fd-a9f1-9ba2a850a3e8 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.766s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:20:39.702412 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.image_utils [None req-91459980-b961-40f8-a543-70cf6e1256a9 tempest-VolumesActionsTest-1114221274 None] 4dacf46f-19f4-40fd-a9f1-9ba2a850a3e8 was raw, no need to convert to raw {{(pid=134173) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Dec 11 21:20:49.991082 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-e04034c6-bbcd-4259-b42a-9e9d3e0cc0f1 tempest-TestVolumeBootPattern-909971433 None] Created reservations ['71e4b191-f02f-4d62-a86e-ead01ddd0b4d', 'e76a7f89-8234-4aa5-9233-d733a1ca2ccb', 'b86c4d03-df85-4e29-8a5b-578265a534c4', '218c26f9-b4b0-443a-9179-ace1e86d7169'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:20:50.097053 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-e04034c6-bbcd-4259-b42a-9e9d3e0cc0f1 tempest-TestVolumeBootPattern-909971433 None] Delete snapshot completed successfully. Dec 11 21:20:50.110341 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-e04034c6-bbcd-4259-b42a-9e9d3e0cc0f1 tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-a3ed6062-9235-41cc-8be3-469449fbeed3-delete_snapshot'" released by "delete_snapshot" :: held 30.401s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:20:54.059697 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-6b8cdd01-f471-4399-9801-6c8489794e38 tempest-TestVolumeBootPattern-909971433 None] Terminate volume connection completed successfully. Dec 11 21:20:54.062896 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-6b8cdd01-f471-4399-9801-6c8489794e38 tempest-TestVolumeBootPattern-909971433 None] Deleting attachment 4c87e43e-bec9-4a0a-884e-dd41cdaacf07. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:20:54.400845 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-d1eab0f9-0638-4e11-b775-6d6c53b5d9fc tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-de4f48ae-e75d-442f-bb31-a458213e7d85-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:20:54.441975 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-d1eab0f9-0638-4e11-b775-6d6c53b5d9fc tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:54.583028 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-d1eab0f9-0638-4e11-b775-6d6c53b5d9fc tempest-TestVolumeBootPattern-909971433 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:20:54.603138 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-d1eab0f9-0638-4e11-b775-6d6c53b5d9fc tempest-TestVolumeBootPattern-909971433 None] deleting rbd volume volume-de4f48ae-e75d-442f-bb31-a458213e7d85 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:20:55.288400 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-d1eab0f9-0638-4e11-b775-6d6c53b5d9fc tempest-TestVolumeBootPattern-909971433 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:20:55.343844 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-d1eab0f9-0638-4e11-b775-6d6c53b5d9fc tempest-TestVolumeBootPattern-909971433 None] deleting parent snapshot volume-de4f48ae-e75d-442f-bb31-a458213e7d85.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:20:55.852085 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:20:55.853896 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:55.883252 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:55.945267 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:20:55.999830 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-d1eab0f9-0638-4e11-b775-6d6c53b5d9fc tempest-TestVolumeBootPattern-909971433 None] Created reservations ['d6f93cdc-8b6c-476d-a7af-a9bf108ea431', '1bfa70b5-bfed-4e5c-8379-9152c894ab3d', 'af196b81-a8e0-4f0f-b20f-95aa70c28989', 'd3f4bd89-1201-469e-a00f-c55dee1710a8'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:20:56.069897 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-d1eab0f9-0638-4e11-b775-6d6c53b5d9fc tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:56.134440 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-d1eab0f9-0638-4e11-b775-6d6c53b5d9fc tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:20:56.192200 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-d1eab0f9-0638-4e11-b775-6d6c53b5d9fc tempest-TestVolumeBootPattern-909971433 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:20:56.196465 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-d1eab0f9-0638-4e11-b775-6d6c53b5d9fc tempest-TestVolumeBootPattern-909971433 None] Deleted volume successfully. Dec 11 21:20:56.219018 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-9639aed3-df4b-4ba4-b7b2-ccf488e1be7b req-d1eab0f9-0638-4e11-b775-6d6c53b5d9fc tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-de4f48ae-e75d-442f-bb31-a458213e7d85-delete_volume'" released by "delete_volume" :: held 1.826s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:21:02.079173 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:21:02.086718 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:21:02.087834 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:21:02.130634 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Flow 'volume_create_manager' (8b1c78b3-3e32-42f1-a2f4-3c05fb681b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:21:02.134693 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff37211-95ac-4935-ae1b-e75fdd75fdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:21:02.151121 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:21:02.187832 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff37211-95ac-4935-ae1b-e75fdd75fdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1760631940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f8227b8-bd5e-456e-866f-fd0bf6c93d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f0381bbbd84752abdbd2d9ae843b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:21:02Z,use_quota=True,user_id='8b579ede23eb483b89f94f8e1696a638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:21:02.197220 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b59f8f-4039-4e05-acd0-abcb6d5c95f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:21:02.203154 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b59f8f-4039-4e05-acd0-abcb6d5c95f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:21:02.209329 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3919dd85-051b-4675-9a9d-1d45a5c7b5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:21:02.371291 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3919dd85-051b-4675-9a9d-1d45a5c7b5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f8227b8-bd5e-456e-866f-fd0bf6c93d27', 'volume_name': 'volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:21:02.373782 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b67e7f-d3f8-47df-bf9a-ba71cacd348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:21:02.386342 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b67e7f-d3f8-47df-bf9a-ba71cacd348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:21:02.389237 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2872cd92-6632-4ff5-ae05-bc6003ee393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:21:02.390303 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Volume 2f8227b8-bd5e-456e-866f-fd0bf6c93d27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 21:21:02.391051 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Cloning 2f8227b8-bd5e-456e-866f-fd0bf6c93d27 from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 21:21:02.403565 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:21:02.425279 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 21, 2, 409357)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:21:02.427068 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:21:02.427777 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 21:21:02.433302 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.030s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:21:02.434506 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 21:21:02.443515 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 21, 2, 439363)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:21:02.444035 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:21:02.444652 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 21:21:02.475520 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:02.558697 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] creating snapshot='volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:21:02.780970 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27.clone_snap' to 'volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:21:02.979900 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:21:02.981142 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:21:02.981625 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:21:03.009895 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:21:03.010811 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Marking volume 2f8227b8-bd5e-456e-866f-fd0bf6c93d27 as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:21:03.023065 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to 2f8227b8-bd5e-456e-866f-fd0bf6c93d27. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 21:21:03.023549 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Creating volume glance metadata for volume 2f8227b8-bd5e-456e-866f-fd0bf6c93d27 backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 21:21:03.090062 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2872cd92-6632-4ff5-ae05-bc6003ee393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:21:03.094110 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa136a8-8524-48d9-8994-b708f21d96a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:21:03.110321 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Volume volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27 (2f8227b8-bd5e-456e-866f-fd0bf6c93d27): created successfully Dec 11 21:21:03.114133 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa136a8-8524-48d9-8994-b708f21d96a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:21:03.117553 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Flow 'volume_create_manager' (8b1c78b3-3e32-42f1-a2f4-3c05fb681b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:21:03.132166 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8fe3d5d4-48c7-4615-aa59-d2f345c4d350 tempest-TestVolumeBootPattern-909971433 None] Created volume successfully. Dec 11 21:21:06.862893 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-18c54ff5-2262-4140-9653-677a12575b23 req-02727126-ef6a-47f1-91da-ae3edc5efafe tempest-TestVolumeBootPattern-909971433 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:21:07.739116 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-91459980-b961-40f8-a543-70cf6e1256a9 tempest-VolumesActionsTest-1114221274 None] Uploaded volume to glance image-id: 4dacf46f-19f4-40fd-a9f1-9ba2a850a3e8. {{(pid=134173) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} Dec 11 21:21:07.764713 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-91459980-b961-40f8-a543-70cf6e1256a9 tempest-VolumesActionsTest-1114221274 None] Copy volume to image completed successfully. Dec 11 21:21:07.866549 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-18c54ff5-2262-4140-9653-677a12575b23 req-02727126-ef6a-47f1-91da-ae3edc5efafe tempest-TestVolumeBootPattern-909971433 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.004s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:21:07.867353 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-18c54ff5-2262-4140-9653-677a12575b23 req-02727126-ef6a-47f1-91da-ae3edc5efafe tempest-TestVolumeBootPattern-909971433 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '2f8227b8-bd5e-456e-866f-fd0bf6c93d27', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:21:07.907745 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-18c54ff5-2262-4140-9653-677a12575b23 req-02727126-ef6a-47f1-91da-ae3edc5efafe tempest-TestVolumeBootPattern-909971433 None] Connection info returned from driver {'name': 'volumes/volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2f8227b8-bd5e-456e-866f-fd0bf6c93d27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7d8a96cd-480c-4171-841b-495efb4401dd'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:21:07.976943 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-18c54ff5-2262-4140-9653-677a12575b23 req-02727126-ef6a-47f1-91da-ae3edc5efafe tempest-TestVolumeBootPattern-909971433 None] attachment_update completed successfully. Dec 11 21:21:08.941868 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-dec485cb-4a59-44f7-a8ff-40626288bf67 tempest-VolumesActionsTest-1114221274 None] Lock "b'cinder-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:21:09.000196 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dec485cb-4a59-44f7-a8ff-40626288bf67 tempest-VolumesActionsTest-1114221274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:09.048281 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dec485cb-4a59-44f7-a8ff-40626288bf67 tempest-VolumesActionsTest-1114221274 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:21:09.048819 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dec485cb-4a59-44f7-a8ff-40626288bf67 tempest-VolumesActionsTest-1114221274 None] Volume volume-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:21:09.054104 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dec485cb-4a59-44f7-a8ff-40626288bf67 tempest-VolumesActionsTest-1114221274 None] deleting rbd volume volume-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:21:09.305210 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-dec485cb-4a59-44f7-a8ff-40626288bf67 tempest-VolumesActionsTest-1114221274 None] Created reservations ['10eb4ce6-befd-43e9-bc13-312bd133016d', '740d93cc-c0c4-4c81-a5d4-916792e9c80f', 'cbd5ea00-647e-4b3b-b8a6-19d28d4c9f5b', '0e318f60-1406-469e-8ba7-2c7fe622c415'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:21:09.347215 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dec485cb-4a59-44f7-a8ff-40626288bf67 tempest-VolumesActionsTest-1114221274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:09.376820 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-dec485cb-4a59-44f7-a8ff-40626288bf67 tempest-VolumesActionsTest-1114221274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:09.402229 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-dec485cb-4a59-44f7-a8ff-40626288bf67 tempest-VolumesActionsTest-1114221274 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:21:09.406573 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-dec485cb-4a59-44f7-a8ff-40626288bf67 tempest-VolumesActionsTest-1114221274 None] Deleted volume successfully. Dec 11 21:21:09.421696 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-dec485cb-4a59-44f7-a8ff-40626288bf67 tempest-VolumesActionsTest-1114221274 None] Lock "b'cinder-0d8ffd7d-a4e5-4a95-9fa8-5c805d55ed66-delete_volume'" released by "delete_volume" :: held 0.480s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:21:12.244958 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:21:12.249238 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:21:12.250250 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:21:12.263998 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Flow 'volume_create_manager' (bcd7442e-aa98-4a55-9649-04cc75da5fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:21:12.267441 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d92b60-f147-4e5e-8156-1c0b7428dbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:21:12.275569 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:21:12.289946 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d92b60-f147-4e5e-8156-1c0b7428dbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-986964133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7b8fecfb-8a31-476e-9a25-646d616ef209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a7df71881824301ac227f7766f83203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:21:12Z,use_quota=True,user_id='084d5736c964429b9b256873506cbed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:21:12.293407 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6184758-3a09-471d-b5b0-774aa96fd4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:21:12.295707 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6184758-3a09-471d-b5b0-774aa96fd4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:21:12.298823 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b889addf-564c-4cdc-8a94-8b115a6ad2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:21:12.301789 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b889addf-564c-4cdc-8a94-8b115a6ad2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8fecfb-8a31-476e-9a25-646d616ef209', 'volume_name': 'volume-7b8fecfb-8a31-476e-9a25-646d616ef209', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:21:12.304273 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b86b73b-8bc1-4bc7-a308-d8205c0c7342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:21:12.307444 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b86b73b-8bc1-4bc7-a308-d8205c0c7342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:21:12.309539 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d92c56-6330-45e4-9f7a-595449906aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:21:12.310518 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Volume 7b8fecfb-8a31-476e-9a25-646d616ef209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8fecfb-8a31-476e-9a25-646d616ef209', 'volume_size': 1} Dec 11 21:21:12.310910 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] creating volume 'volume-7b8fecfb-8a31-476e-9a25-646d616ef209' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:21:12.311891 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:12.394342 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:21:12.395262 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:21:12.398246 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d92c56-6330-45e4-9f7a-595449906aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8fecfb-8a31-476e-9a25-646d616ef209', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:21:12.401642 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071d2844-dfba-43b8-a426-33b6bd0038dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:21:12.411343 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Volume volume-7b8fecfb-8a31-476e-9a25-646d616ef209 (7b8fecfb-8a31-476e-9a25-646d616ef209): created successfully Dec 11 21:21:12.414736 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071d2844-dfba-43b8-a426-33b6bd0038dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:21:12.419127 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Flow 'volume_create_manager' (bcd7442e-aa98-4a55-9649-04cc75da5fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:21:12.429580 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-562c2812-58d7-48bd-9be9-45c96bf895ab tempest-VolumesSnapshotListTestJSON-1658940931 None] Created volume successfully. Dec 11 21:21:13.397080 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d40a4a7b-4dbc-40ad-b90f-787ea915bc63 tempest-VolumesSnapshotListTestJSON-1658940931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:14.293338 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d40a4a7b-4dbc-40ad-b90f-787ea915bc63 tempest-VolumesSnapshotListTestJSON-1658940931 None] Create snapshot completed successfully Dec 11 21:21:14.587707 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b0e3e2da-4c94-45ab-9fef-5bf9f2e9dfe9 tempest-VolumesSnapshotListTestJSON-1658940931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:15.329548 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b0e3e2da-4c94-45ab-9fef-5bf9f2e9dfe9 tempest-VolumesSnapshotListTestJSON-1658940931 None] Create snapshot completed successfully Dec 11 21:21:15.767940 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7c7fa8f7-8282-4501-a27e-532ab1e2f8fa tempest-VolumesSnapshotListTestJSON-1658940931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:16.350598 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7c7fa8f7-8282-4501-a27e-532ab1e2f8fa tempest-VolumesSnapshotListTestJSON-1658940931 None] Create snapshot completed successfully Dec 11 21:21:17.437969 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-9cc03e24-3655-40f1-aca4-ff10955855fa tempest-VolumesSnapshotListTestJSON-1658940931 None] Lock "b'cinder-4228f1c7-ee40-4196-8713-13eb8d1e7b62-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:21:17.439406 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9cc03e24-3655-40f1-aca4-ff10955855fa tempest-VolumesSnapshotListTestJSON-1658940931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:18.352878 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-9cc03e24-3655-40f1-aca4-ff10955855fa tempest-VolumesSnapshotListTestJSON-1658940931 None] Created reservations ['8857ad94-6633-4a94-bd0a-435a8e2bb089', '7feec3b4-e209-493c-b3a7-7e7c1e2f409d', 'a1189ac3-9045-4f4f-b680-aee708fec7ed', 'aa4c847b-3f1d-48f1-aec8-193addc5df97'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:21:18.387351 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9cc03e24-3655-40f1-aca4-ff10955855fa tempest-VolumesSnapshotListTestJSON-1658940931 None] Delete snapshot completed successfully. Dec 11 21:21:18.392557 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-9cc03e24-3655-40f1-aca4-ff10955855fa tempest-VolumesSnapshotListTestJSON-1658940931 None] Lock "b'cinder-4228f1c7-ee40-4196-8713-13eb8d1e7b62-delete_snapshot'" released by "delete_snapshot" :: held 0.955s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:21:18.535101 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8ca94c85-2f07-4e5c-bd2b-9883f1822db7 tempest-VolumesSnapshotListTestJSON-1658940931 None] Lock "b'cinder-76eb5dfc-261c-4bab-aab8-6b2d86948fa7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:21:18.536867 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8ca94c85-2f07-4e5c-bd2b-9883f1822db7 tempest-VolumesSnapshotListTestJSON-1658940931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:19.378955 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-8ca94c85-2f07-4e5c-bd2b-9883f1822db7 tempest-VolumesSnapshotListTestJSON-1658940931 None] Created reservations ['2c98a9fc-5f20-477e-b3c3-683ac6cc004b', '32a0656e-7aea-46d3-9a17-814c881655d0', '54e47588-c0eb-488e-92be-c2bc6caceebf', '364a5946-bc26-43fe-a9b5-c97f1d7b364c'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:21:19.421140 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8ca94c85-2f07-4e5c-bd2b-9883f1822db7 tempest-VolumesSnapshotListTestJSON-1658940931 None] Delete snapshot completed successfully. Dec 11 21:21:19.428793 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-8ca94c85-2f07-4e5c-bd2b-9883f1822db7 tempest-VolumesSnapshotListTestJSON-1658940931 None] Lock "b'cinder-76eb5dfc-261c-4bab-aab8-6b2d86948fa7-delete_snapshot'" released by "delete_snapshot" :: held 0.894s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:21:19.643315 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-5dddda83-b6a3-4ed5-a750-46d8f42efd71 tempest-VolumesSnapshotListTestJSON-1658940931 None] Lock "b'cinder-e847f353-ddb3-47ea-9dd2-6a3fc1fcc0b0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:21:19.646344 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5dddda83-b6a3-4ed5-a750-46d8f42efd71 tempest-VolumesSnapshotListTestJSON-1658940931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:20.413546 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-5dddda83-b6a3-4ed5-a750-46d8f42efd71 tempest-VolumesSnapshotListTestJSON-1658940931 None] Created reservations ['42d18738-cbf9-4aa8-85d4-935c590cdf66', 'a2f18bec-5a51-43a2-b619-5ef4d3a7b59b', 'ee843d32-d77c-478a-9799-c48b7648f197', 'd3bb61d5-9dbd-494b-9e71-60d661d9a2c2'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:21:20.477617 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-5dddda83-b6a3-4ed5-a750-46d8f42efd71 tempest-VolumesSnapshotListTestJSON-1658940931 None] Delete snapshot completed successfully. Dec 11 21:21:20.485481 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-5dddda83-b6a3-4ed5-a750-46d8f42efd71 tempest-VolumesSnapshotListTestJSON-1658940931 None] Lock "b'cinder-e847f353-ddb3-47ea-9dd2-6a3fc1fcc0b0-delete_snapshot'" released by "delete_snapshot" :: held 0.842s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:21:20.784691 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-a616b714-04c8-4d79-bef0-63db3f39096d tempest-VolumesSnapshotListTestJSON-1658940931 None] Lock "b'cinder-7b8fecfb-8a31-476e-9a25-646d616ef209-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:21:20.838889 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a616b714-04c8-4d79-bef0-63db3f39096d tempest-VolumesSnapshotListTestJSON-1658940931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:20.902342 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a616b714-04c8-4d79-bef0-63db3f39096d tempest-VolumesSnapshotListTestJSON-1658940931 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:21:20.902881 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a616b714-04c8-4d79-bef0-63db3f39096d tempest-VolumesSnapshotListTestJSON-1658940931 None] Volume volume-7b8fecfb-8a31-476e-9a25-646d616ef209 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:21:20.910647 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a616b714-04c8-4d79-bef0-63db3f39096d tempest-VolumesSnapshotListTestJSON-1658940931 None] deleting rbd volume volume-7b8fecfb-8a31-476e-9a25-646d616ef209 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:21:21.187188 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-a616b714-04c8-4d79-bef0-63db3f39096d tempest-VolumesSnapshotListTestJSON-1658940931 None] Created reservations ['9e41e37f-4888-42b1-b082-85b067a1f5ae', 'bb0a0623-e804-4c36-b8a5-d0bb138f4be6', '162ee217-eebb-4542-9952-c60a4245bec9', 'ec941623-c799-4e4d-8639-8823de5873ae'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:21:21.234814 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a616b714-04c8-4d79-bef0-63db3f39096d tempest-VolumesSnapshotListTestJSON-1658940931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:21.274187 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a616b714-04c8-4d79-bef0-63db3f39096d tempest-VolumesSnapshotListTestJSON-1658940931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:21.319350 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-a616b714-04c8-4d79-bef0-63db3f39096d tempest-VolumesSnapshotListTestJSON-1658940931 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:21:21.326364 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-a616b714-04c8-4d79-bef0-63db3f39096d tempest-VolumesSnapshotListTestJSON-1658940931 None] Deleted volume successfully. Dec 11 21:21:21.338397 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-a616b714-04c8-4d79-bef0-63db3f39096d tempest-VolumesSnapshotListTestJSON-1658940931 None] Lock "b'cinder-7b8fecfb-8a31-476e-9a25-646d616ef209-delete_volume'" released by "delete_volume" :: held 0.565s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:21:55.859157 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:21:55.859845 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:55.904504 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:21:55.973029 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:22:02.775489 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-80f2e5d2-33d8-4a2c-91f8-eca6b0bf72d8 tempest-GroupSnapshotsTest-672204617 None] Group tempest-GroupSnapshotsTest-Group-2089672850: creating Dec 11 21:22:02.793324 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-80f2e5d2-33d8-4a2c-91f8-eca6b0bf72d8 tempest-GroupSnapshotsTest-672204617 None] Group tempest-GroupSnapshotsTest-Group-2089672850: created successfully Dec 11 21:22:02.803072 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-80f2e5d2-33d8-4a2c-91f8-eca6b0bf72d8 tempest-GroupSnapshotsTest-672204617 None] Create group completed successfully. Dec 11 21:22:04.193108 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:22:04.197204 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:22:04.198157 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:22:04.211958 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Flow 'volume_create_manager' (df28c4e5-f07a-49c2-bf80-4194f336cecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:04.215900 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32bd4410-71f5-479c-ae5d-5335fcf6d084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:04.222689 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:22:04.235476 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32bd4410-71f5-479c-ae5d-5335fcf6d084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-671038670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c48332f-400d-46d5-b557-dcaff8fd4e30,host='ncdv-master-1@ceph#ceph',id=96b4ccf1-7644-43ea-ac5a-b530752a843c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba38929a16a14995bcc0fcb60f944110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:22:04Z,use_quota=True,user_id='771dcff4613f4fe4b3b580ead3a32c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(495b6ccc-ccee-4369-af43-0e59f0192c30),volume_type_id=495b6ccc-ccee-4369-af43-0e59f0192c30)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:04.238137 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0a3d3d-3bbe-41db-ab72-29cfeb3c6a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:04.240311 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0a3d3d-3bbe-41db-ab72-29cfeb3c6a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:04.242818 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a053fe3c-95ad-4825-9141-74cfeb028ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:04.245218 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a053fe3c-95ad-4825-9141-74cfeb028ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96b4ccf1-7644-43ea-ac5a-b530752a843c', 'volume_name': 'volume-96b4ccf1-7644-43ea-ac5a-b530752a843c', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:04.247447 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842235a9-b77d-44b5-8222-c0d85ef66361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:04.249560 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842235a9-b77d-44b5-8222-c0d85ef66361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:04.251875 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc91feda-a07c-46e2-bb6d-bd31db6f96b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:04.266332 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Volume 96b4ccf1-7644-43ea-ac5a-b530752a843c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96b4ccf1-7644-43ea-ac5a-b530752a843c', 'volume_size': 1} Dec 11 21:22:04.266760 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] creating volume 'volume-96b4ccf1-7644-43ea-ac5a-b530752a843c' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:22:04.267765 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:04.326425 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] extra_specs: {} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:22:04.327191 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] extra_specs: {} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:22:04.329363 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc91feda-a07c-46e2-bb6d-bd31db6f96b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b4ccf1-7644-43ea-ac5a-b530752a843c', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:04.331642 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e90877a-d12a-49bd-b7bd-2a1db9f27860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:04.341304 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Volume volume-96b4ccf1-7644-43ea-ac5a-b530752a843c (96b4ccf1-7644-43ea-ac5a-b530752a843c): created successfully Dec 11 21:22:04.343620 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e90877a-d12a-49bd-b7bd-2a1db9f27860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:04.346925 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Flow 'volume_create_manager' (df28c4e5-f07a-49c2-bf80-4194f336cecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:04.354765 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c19f4f24-ef5b-40b6-b249-33c9f65d6c28 tempest-GroupSnapshotsTest-672204617 None] Created volume successfully. Dec 11 21:22:05.476934 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b3086498-022e-4ae9-afbd-eddd4caf25da tempest-GroupSnapshotsTest-672204617 None] GroupSnapshot 49e84042-448a-48d8-bd22-bbf0e0851b39: creating. Dec 11 21:22:05.529886 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b3086498-022e-4ae9-afbd-eddd4caf25da tempest-GroupSnapshotsTest-672204617 None] Group snapshot 49e84042-448a-48d8-bd22-bbf0e0851b39: creating. {{(pid=134173) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Dec 11 21:22:05.548316 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b3086498-022e-4ae9-afbd-eddd4caf25da tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:05.883529 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b3086498-022e-4ae9-afbd-eddd4caf25da tempest-GroupSnapshotsTest-672204617 None] group_snapshot 49e84042-448a-48d8-bd22-bbf0e0851b39: created successfully Dec 11 21:22:07.115558 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8760010c-4b1d-4b63-8dfd-2b43a498188e tempest-GroupSnapshotsTest-672204617 None] cloning volumes/volume-96b4ccf1-7644-43ea-ac5a-b530752a843c@snapshot-c4453854-3e31-4dd4-b040-a7a168ed4499 to volume-a5f17fc0-0c21-49c5-b9c6-cfdf9d9ad16b {{(pid=134173) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 11 21:22:07.116241 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8760010c-4b1d-4b63-8dfd-2b43a498188e tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:07.171731 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8760010c-4b1d-4b63-8dfd-2b43a498188e tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:07.355143 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8760010c-4b1d-4b63-8dfd-2b43a498188e tempest-GroupSnapshotsTest-672204617 None] extra_specs: {} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:22:07.355143 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8760010c-4b1d-4b63-8dfd-2b43a498188e tempest-GroupSnapshotsTest-672204617 None] extra_specs: {} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:22:07.417740 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8760010c-4b1d-4b63-8dfd-2b43a498188e tempest-GroupSnapshotsTest-672204617 None] Create group from source-snapshot-49e84042-448a-48d8-bd22-bbf0e0851b39 completed successfully. Dec 11 21:22:08.658040 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b39b69ef-47b8-41dd-988a-522f86154d0a tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:08.742221 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b39b69ef-47b8-41dd-988a-522f86154d0a tempest-GroupSnapshotsTest-672204617 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:22:08.755041 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b39b69ef-47b8-41dd-988a-522f86154d0a tempest-GroupSnapshotsTest-672204617 None] deleting rbd volume volume-a5f17fc0-0c21-49c5-b9c6-cfdf9d9ad16b {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:22:09.105850 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-b39b69ef-47b8-41dd-988a-522f86154d0a tempest-GroupSnapshotsTest-672204617 None] Created reservations ['ab2e2950-0c27-437c-ae57-606d55747510'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:09.132843 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-b39b69ef-47b8-41dd-988a-522f86154d0a tempest-GroupSnapshotsTest-672204617 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1953828264 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1953828264, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:22:09.134294 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-b39b69ef-47b8-41dd-988a-522f86154d0a tempest-GroupSnapshotsTest-672204617 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1953828264 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1953828264, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:22:09.153852 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-b39b69ef-47b8-41dd-988a-522f86154d0a tempest-GroupSnapshotsTest-672204617 None] Created reservations ['6ef88bbb-c6a7-4669-bc5e-23566fa49976', 'f41cab8f-491a-43f5-9e54-d8b4a69333d6', '5cbf093a-3204-43d5-9514-46ae39338062', 'a7bcadad-1bb2-43bf-8ae6-73d07b7b7fcf'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:09.250021 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b39b69ef-47b8-41dd-988a-522f86154d0a tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:09.293328 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b39b69ef-47b8-41dd-988a-522f86154d0a tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:09.332048 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-b39b69ef-47b8-41dd-988a-522f86154d0a tempest-GroupSnapshotsTest-672204617 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:22:09.336773 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b39b69ef-47b8-41dd-988a-522f86154d0a tempest-GroupSnapshotsTest-672204617 None] Delete group completed successfully. Dec 11 21:22:09.824324 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4d7eeb50-2688-441b-b237-c708bf78769a tempest-GroupSnapshotsTest-672204617 None] group_snapshot 49e84042-448a-48d8-bd22-bbf0e0851b39: deleting Dec 11 21:22:09.840738 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4d7eeb50-2688-441b-b237-c708bf78769a tempest-GroupSnapshotsTest-672204617 None] group_snapshot 49e84042-448a-48d8-bd22-bbf0e0851b39: deleting {{(pid=134173) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Dec 11 21:22:09.858830 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4d7eeb50-2688-441b-b237-c708bf78769a tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:10.411151 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-4d7eeb50-2688-441b-b237-c708bf78769a tempest-GroupSnapshotsTest-672204617 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1953828264 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1953828264, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:22:10.429227 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-4d7eeb50-2688-441b-b237-c708bf78769a tempest-GroupSnapshotsTest-672204617 None] Created reservations ['000f4752-7c99-4011-afe4-1a10870f76ed', 'c4f6c81a-c4d4-4e1d-8b06-bf58833688c0', 'cf93f024-a781-4224-a4a0-78df4475e180', '50760606-d613-4908-b2bf-070475d426e2'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:10.483421 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4d7eeb50-2688-441b-b237-c708bf78769a tempest-GroupSnapshotsTest-672204617 None] group_snapshot 49e84042-448a-48d8-bd22-bbf0e0851b39: deleted successfully Dec 11 21:22:11.289123 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b8752ae0-dde4-4540-9319-888907024faa tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:11.364033 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b8752ae0-dde4-4540-9319-888907024faa tempest-GroupSnapshotsTest-672204617 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:22:11.364467 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b8752ae0-dde4-4540-9319-888907024faa tempest-GroupSnapshotsTest-672204617 None] Volume volume-96b4ccf1-7644-43ea-ac5a-b530752a843c is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:22:11.376077 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b8752ae0-dde4-4540-9319-888907024faa tempest-GroupSnapshotsTest-672204617 None] deleting rbd volume volume-96b4ccf1-7644-43ea-ac5a-b530752a843c {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:22:11.772521 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-b8752ae0-dde4-4540-9319-888907024faa tempest-GroupSnapshotsTest-672204617 None] Created reservations ['c81a43d4-db7e-479b-91e1-8eaefd0f98e3'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:11.801954 ncdv-master-1 cinder-volume[134173]: WARNING cinder.db.sqlalchemy.api [None req-b8752ae0-dde4-4540-9319-888907024faa tempest-GroupSnapshotsTest-672204617 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1953828264'] Dec 11 21:22:11.807983 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-b8752ae0-dde4-4540-9319-888907024faa tempest-GroupSnapshotsTest-672204617 None] Created reservations ['2a5d17c2-e2d7-4693-b3d7-84dbbaa10504', '7f0909a9-3da6-4ca9-b124-782800ee1e8d', '26699444-4542-40bf-8da0-bfe1bf915483', 'ccd27a21-a50e-45a7-9fb0-11ea1115c293'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:11.910207 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b8752ae0-dde4-4540-9319-888907024faa tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:11.961801 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b8752ae0-dde4-4540-9319-888907024faa tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:12.021441 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-b8752ae0-dde4-4540-9319-888907024faa tempest-GroupSnapshotsTest-672204617 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:22:12.026960 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b8752ae0-dde4-4540-9319-888907024faa tempest-GroupSnapshotsTest-672204617 None] Delete group completed successfully. Dec 11 21:22:12.678118 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-992a42da-2a61-4047-bf4d-e9a9e348d099 tempest-GroupSnapshotsTest-672204617 None] Group tempest-GroupSnapshotsTest-Group-1594398201: creating Dec 11 21:22:12.696908 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-992a42da-2a61-4047-bf4d-e9a9e348d099 tempest-GroupSnapshotsTest-672204617 None] Group tempest-GroupSnapshotsTest-Group-1594398201: created successfully Dec 11 21:22:12.706464 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-992a42da-2a61-4047-bf4d-e9a9e348d099 tempest-GroupSnapshotsTest-672204617 None] Create group completed successfully. Dec 11 21:22:14.141504 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:22:14.145097 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:22:14.145742 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:22:14.161728 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Flow 'volume_create_manager' (63930a4c-bcf4-4621-80dc-b25db1b311bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:14.165469 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da70ec2-52c4-49dd-b07d-d8341036c09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:14.175491 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:22:14.209140 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da70ec2-52c4-49dd-b07d-d8341036c09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-972609977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fb12971-a17d-4a3e-b869-2957bea47f28,host='ncdv-master-1@ceph#ceph',id=64caacd8-da49-4ddc-8609-fad907d00a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba38929a16a14995bcc0fcb60f944110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:22:14Z,use_quota=True,user_id='771dcff4613f4fe4b3b580ead3a32c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c399c90a-3486-451b-8403-7ef8b907eb6b),volume_type_id=c399c90a-3486-451b-8403-7ef8b907eb6b)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:14.211810 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70506176-f48e-44cf-8d50-a6233513701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:14.214052 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70506176-f48e-44cf-8d50-a6233513701e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:14.225100 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97dbb59d-ed21-4987-81f3-fb8bd01e8131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:14.227490 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97dbb59d-ed21-4987-81f3-fb8bd01e8131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64caacd8-da49-4ddc-8609-fad907d00a5b', 'volume_name': 'volume-64caacd8-da49-4ddc-8609-fad907d00a5b', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:14.229897 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5488765-5db4-4917-8a22-408161693951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:14.232184 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5488765-5db4-4917-8a22-408161693951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:14.234413 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89decae-a7ba-4403-b6f1-ad8d89efec07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:14.268694 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Volume 64caacd8-da49-4ddc-8609-fad907d00a5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64caacd8-da49-4ddc-8609-fad907d00a5b', 'volume_size': 1} Dec 11 21:22:14.272321 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] creating volume 'volume-64caacd8-da49-4ddc-8609-fad907d00a5b' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:22:14.273375 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:14.384886 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] extra_specs: {} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:22:14.385281 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] extra_specs: {} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:22:14.387464 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89decae-a7ba-4403-b6f1-ad8d89efec07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64caacd8-da49-4ddc-8609-fad907d00a5b', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:14.390091 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac49ef1e-9afd-4d67-90aa-9040d0d91e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:14.404011 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Volume volume-64caacd8-da49-4ddc-8609-fad907d00a5b (64caacd8-da49-4ddc-8609-fad907d00a5b): created successfully Dec 11 21:22:14.409743 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac49ef1e-9afd-4d67-90aa-9040d0d91e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:14.416875 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Flow 'volume_create_manager' (63930a4c-bcf4-4621-80dc-b25db1b311bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:14.446404 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c85c1dc5-0ba4-4d39-a6d5-107403c4d431 tempest-GroupSnapshotsTest-672204617 None] Created volume successfully. Dec 11 21:22:15.832320 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:22:15.835678 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:22:15.836125 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:22:15.855159 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Flow 'volume_create_manager' (27de9973-b51f-4c00-bca9-bdae09312f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:15.860542 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339b74d4-7cb0-4761-96d5-311be83f09b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:15.868671 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:22:15.893735 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339b74d4-7cb0-4761-96d5-311be83f09b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1952618425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fb12971-a17d-4a3e-b869-2957bea47f28,host='ncdv-master-1@ceph#ceph',id=bd6e4d88-9914-447e-b8b5-4992d4f6c4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba38929a16a14995bcc0fcb60f944110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:22:16Z,use_quota=True,user_id='771dcff4613f4fe4b3b580ead3a32c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c399c90a-3486-451b-8403-7ef8b907eb6b),volume_type_id=c399c90a-3486-451b-8403-7ef8b907eb6b)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:15.897358 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15fe940-d0a0-4c52-9115-a7f3e8c06dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:15.901155 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15fe940-d0a0-4c52-9115-a7f3e8c06dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:15.904681 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49818b56-cfa3-41fc-9032-e9f5595d2412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:15.909071 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49818b56-cfa3-41fc-9032-e9f5595d2412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd6e4d88-9914-447e-b8b5-4992d4f6c4ba', 'volume_name': 'volume-bd6e4d88-9914-447e-b8b5-4992d4f6c4ba', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:15.913722 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b9abe0-dd6c-406d-8f0c-762284076f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:15.917110 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b9abe0-dd6c-406d-8f0c-762284076f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:15.920421 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caac746b-76ef-4cc0-83f8-40f61834a711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:15.939391 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Volume bd6e4d88-9914-447e-b8b5-4992d4f6c4ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd6e4d88-9914-447e-b8b5-4992d4f6c4ba', 'volume_size': 1} Dec 11 21:22:15.939829 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] creating volume 'volume-bd6e4d88-9914-447e-b8b5-4992d4f6c4ba' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:22:15.940809 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:16.014047 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] extra_specs: {} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:22:16.014938 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] extra_specs: {} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:22:16.017470 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caac746b-76ef-4cc0-83f8-40f61834a711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd6e4d88-9914-447e-b8b5-4992d4f6c4ba', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:16.020403 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728ea617-1898-469b-8673-df2bfbf241ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:16.032635 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Volume volume-bd6e4d88-9914-447e-b8b5-4992d4f6c4ba (bd6e4d88-9914-447e-b8b5-4992d4f6c4ba): created successfully Dec 11 21:22:16.035422 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728ea617-1898-469b-8673-df2bfbf241ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:16.039077 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Flow 'volume_create_manager' (27de9973-b51f-4c00-bca9-bdae09312f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:16.052823 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b699ebdc-4a5c-4c94-8a06-3e89624195af tempest-GroupSnapshotsTest-672204617 None] Created volume successfully. Dec 11 21:22:17.016388 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d7e64fbb-7f93-45e1-828e-da9023183bc0 tempest-GroupSnapshotsTest-672204617 None] Update group completed successfully. Dec 11 21:22:18.227292 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d9939923-bb92-494e-a20a-59c7149928fb tempest-GroupSnapshotsTest-672204617 None] Update group completed successfully. Dec 11 21:22:19.343565 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c4d61359-e3cd-436c-a973-55d81b13b188 tempest-GroupSnapshotsTest-672204617 None] Update group completed successfully. Dec 11 21:22:20.474247 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-551393de-e450-4802-a0e1-36442bc618ef tempest-GroupSnapshotsTest-672204617 None] Update group completed successfully. Dec 11 21:22:21.765004 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7dc00a59-8559-4fcc-aa10-834912f63f67 tempest-GroupSnapshotsTest-672204617 None] GroupSnapshot 305c2af5-df72-4c24-87a7-a50827f6a292: creating. Dec 11 21:22:21.781294 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-7dc00a59-8559-4fcc-aa10-834912f63f67 tempest-GroupSnapshotsTest-672204617 None] Group snapshot 305c2af5-df72-4c24-87a7-a50827f6a292: creating. {{(pid=134173) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Dec 11 21:22:21.796081 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7dc00a59-8559-4fcc-aa10-834912f63f67 tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:22.761524 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7dc00a59-8559-4fcc-aa10-834912f63f67 tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:23.843429 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7dc00a59-8559-4fcc-aa10-834912f63f67 tempest-GroupSnapshotsTest-672204617 None] group_snapshot 305c2af5-df72-4c24-87a7-a50827f6a292: created successfully Dec 11 21:22:23.988638 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ce9bd8ac-3705-491f-b793-4292a301614d tempest-GroupSnapshotsTest-672204617 None] group_snapshot 305c2af5-df72-4c24-87a7-a50827f6a292: deleting Dec 11 21:22:24.003811 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-ce9bd8ac-3705-491f-b793-4292a301614d tempest-GroupSnapshotsTest-672204617 None] group_snapshot 305c2af5-df72-4c24-87a7-a50827f6a292: deleting {{(pid=134173) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Dec 11 21:22:24.022572 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ce9bd8ac-3705-491f-b793-4292a301614d tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:24.839387 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-ce9bd8ac-3705-491f-b793-4292a301614d tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:25.825563 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-ce9bd8ac-3705-491f-b793-4292a301614d tempest-GroupSnapshotsTest-672204617 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-457334750 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-457334750, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:22:25.826281 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-ce9bd8ac-3705-491f-b793-4292a301614d tempest-GroupSnapshotsTest-672204617 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-457334750 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-457334750, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:22:25.840337 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-ce9bd8ac-3705-491f-b793-4292a301614d tempest-GroupSnapshotsTest-672204617 None] Created reservations ['4e91369c-ed5a-4533-afe0-2193a09621f8', 'd5637390-7721-4a4a-b145-a85716e0d769', 'b9f20f09-8344-4e37-a6bf-f26c610b8c81', '4aaeccac-4411-4284-90d1-ee19fda4cc21'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:25.912891 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-ce9bd8ac-3705-491f-b793-4292a301614d tempest-GroupSnapshotsTest-672204617 None] Created reservations ['87943a11-1b28-4189-82a4-b34d48e0fb34', '3cbc6819-8f4b-46e5-ac34-e1c99944adb4', '1b992e28-9ac4-4e36-8de9-121858e26915', '96b2567a-592e-4f72-b1b0-0ac7b3e4c3c7'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:25.952571 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-ce9bd8ac-3705-491f-b793-4292a301614d tempest-GroupSnapshotsTest-672204617 None] group_snapshot 305c2af5-df72-4c24-87a7-a50827f6a292: deleted successfully Dec 11 21:22:26.500229 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:26.551311 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:22:26.551736 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] Volume volume-64caacd8-da49-4ddc-8609-fad907d00a5b is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:22:26.558012 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] deleting rbd volume volume-64caacd8-da49-4ddc-8609-fad907d00a5b {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:22:26.813158 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:26.863375 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:22:26.864082 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] Volume volume-bd6e4d88-9914-447e-b8b5-4992d4f6c4ba is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:22:26.872414 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] deleting rbd volume volume-bd6e4d88-9914-447e-b8b5-4992d4f6c4ba {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:22:27.201919 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] Created reservations ['defe6ccb-b8ca-4e2d-9816-6d034e0b8423'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:27.219642 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-457334750 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-457334750, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:22:27.236863 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] Created reservations ['54b1e142-4964-49d6-8417-938bb11f1877', '03eb8a00-3f1b-4bb6-b0a7-f792df574d3b', '6848fb26-cbdb-4638-a298-89b523e8b0a0', '2047c8e9-da5c-4163-be71-4c480c1b950f'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:27.309523 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] Created reservations ['5199d5bf-f7c4-449c-9bea-905079c05dfd', '54e94e5b-c943-460b-81f0-14b9d450722f', 'acc510ed-9604-4082-b91e-78e6f68ea737', '7f9e2497-928b-4684-ae15-06f82dcc110a'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:27.380295 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:27.410120 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:27.435941 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:22:27.440134 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9ae8c638-2863-44f8-8070-915c580afb78 tempest-GroupSnapshotsTest-672204617 None] Delete group completed successfully. Dec 11 21:22:27.839573 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-88ed0aa0-5e4a-4e73-8902-b7b1f8aff478 tempest-GroupSnapshotsTest-672204617 None] Group tempest-GroupSnapshotsTest-Group-363804768: creating Dec 11 21:22:27.857340 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-88ed0aa0-5e4a-4e73-8902-b7b1f8aff478 tempest-GroupSnapshotsTest-672204617 None] Group tempest-GroupSnapshotsTest-Group-363804768: created successfully Dec 11 21:22:27.866369 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-88ed0aa0-5e4a-4e73-8902-b7b1f8aff478 tempest-GroupSnapshotsTest-672204617 None] Create group completed successfully. Dec 11 21:22:29.210077 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:22:29.213893 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:22:29.214335 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:22:29.227103 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Flow 'volume_create_manager' (e08a5327-c8b1-4202-8382-a91e3b9577b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:29.231189 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e311453e-19a3-485d-9bc1-e7ee5b317cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:29.237581 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:22:29.249999 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e311453e-19a3-485d-9bc1-e7ee5b317cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-22049103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4eb1fdb9-d266-4a21-9ca4-6f53d3970d34,host='ncdv-master-1@ceph#ceph',id=390d480b-256a-44aa-863d-7ca052f6bd1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba38929a16a14995bcc0fcb60f944110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:22:29Z,use_quota=True,user_id='771dcff4613f4fe4b3b580ead3a32c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71b2053a-f696-4dd0-99f1-7c85a6206c31),volume_type_id=71b2053a-f696-4dd0-99f1-7c85a6206c31)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:29.255794 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91afe118-9736-430a-9333-c397f4ba7860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:29.258270 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91afe118-9736-430a-9333-c397f4ba7860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:29.260881 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9eb11b3-feed-4430-9923-9d3fa7c29e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:29.263243 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9eb11b3-feed-4430-9923-9d3fa7c29e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '390d480b-256a-44aa-863d-7ca052f6bd1f', 'volume_name': 'volume-390d480b-256a-44aa-863d-7ca052f6bd1f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:29.265588 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0e1ec9-5a8d-4d0e-9c3b-34cfc0944295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:29.267772 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0e1ec9-5a8d-4d0e-9c3b-34cfc0944295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:29.270115 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45723b51-b948-44cc-9ef3-fb1b98927a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:29.284814 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Volume 390d480b-256a-44aa-863d-7ca052f6bd1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-390d480b-256a-44aa-863d-7ca052f6bd1f', 'volume_size': 1} Dec 11 21:22:29.285221 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] creating volume 'volume-390d480b-256a-44aa-863d-7ca052f6bd1f' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:22:29.286228 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:29.348835 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] extra_specs: {} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:22:29.349327 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] extra_specs: {} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:22:29.351481 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45723b51-b948-44cc-9ef3-fb1b98927a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390d480b-256a-44aa-863d-7ca052f6bd1f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:29.354395 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6b4b3e-0a75-4290-90bd-d58bd8a0271a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:29.363501 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Volume volume-390d480b-256a-44aa-863d-7ca052f6bd1f (390d480b-256a-44aa-863d-7ca052f6bd1f): created successfully Dec 11 21:22:29.365749 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6b4b3e-0a75-4290-90bd-d58bd8a0271a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:29.368866 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Flow 'volume_create_manager' (e08a5327-c8b1-4202-8382-a91e3b9577b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:29.382168 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-2689a755-7517-4974-82d0-1abfbd39e65f tempest-GroupSnapshotsTest-672204617 None] Created volume successfully. Dec 11 21:22:30.408770 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-092071c2-2311-4057-b820-e3d79c6fde6b tempest-GroupSnapshotsTest-672204617 None] GroupSnapshot 6ab0a5e7-4145-4f77-b5c7-b4101021f358: creating. Dec 11 21:22:30.421547 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-092071c2-2311-4057-b820-e3d79c6fde6b tempest-GroupSnapshotsTest-672204617 None] Group snapshot 6ab0a5e7-4145-4f77-b5c7-b4101021f358: creating. {{(pid=134173) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Dec 11 21:22:30.437246 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-092071c2-2311-4057-b820-e3d79c6fde6b tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:30.637059 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-092071c2-2311-4057-b820-e3d79c6fde6b tempest-GroupSnapshotsTest-672204617 None] group_snapshot 6ab0a5e7-4145-4f77-b5c7-b4101021f358: created successfully Dec 11 21:22:31.626165 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8a2c1423-18a1-47ab-8274-f74b3b3e78c9 tempest-GroupSnapshotsTest-672204617 None] group_snapshot 6ab0a5e7-4145-4f77-b5c7-b4101021f358: deleting Dec 11 21:22:31.642725 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8a2c1423-18a1-47ab-8274-f74b3b3e78c9 tempest-GroupSnapshotsTest-672204617 None] group_snapshot 6ab0a5e7-4145-4f77-b5c7-b4101021f358: deleting {{(pid=134173) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Dec 11 21:22:31.657900 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8a2c1423-18a1-47ab-8274-f74b3b3e78c9 tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:32.637183 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-8a2c1423-18a1-47ab-8274-f74b3b3e78c9 tempest-GroupSnapshotsTest-672204617 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-422490691 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-422490691, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:22:32.637964 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-8a2c1423-18a1-47ab-8274-f74b3b3e78c9 tempest-GroupSnapshotsTest-672204617 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-422490691 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-422490691, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:22:32.651047 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-8a2c1423-18a1-47ab-8274-f74b3b3e78c9 tempest-GroupSnapshotsTest-672204617 None] Created reservations ['5655efe0-083b-4d69-b013-2adc03e95c22', '37170974-0880-4b5a-a05a-01954a0062cd', '56fa7cc5-c4c9-4f65-a2f7-f410ebe01ecb', '5995f4ef-d0ea-4b47-a1af-c0fa4d439677'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:32.691492 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8a2c1423-18a1-47ab-8274-f74b3b3e78c9 tempest-GroupSnapshotsTest-672204617 None] group_snapshot 6ab0a5e7-4145-4f77-b5c7-b4101021f358: deleted successfully Dec 11 21:22:33.022119 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b5b79d63-e3b2-4833-95fd-ad29de995680 tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:33.062505 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b5b79d63-e3b2-4833-95fd-ad29de995680 tempest-GroupSnapshotsTest-672204617 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:22:33.062924 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b5b79d63-e3b2-4833-95fd-ad29de995680 tempest-GroupSnapshotsTest-672204617 None] Volume volume-390d480b-256a-44aa-863d-7ca052f6bd1f is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:22:33.067673 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b5b79d63-e3b2-4833-95fd-ad29de995680 tempest-GroupSnapshotsTest-672204617 None] deleting rbd volume volume-390d480b-256a-44aa-863d-7ca052f6bd1f {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:22:33.260967 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-b5b79d63-e3b2-4833-95fd-ad29de995680 tempest-GroupSnapshotsTest-672204617 None] Created reservations ['0b1167a7-58ea-4537-91ab-6c01418fc6aa'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:33.277637 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-b5b79d63-e3b2-4833-95fd-ad29de995680 tempest-GroupSnapshotsTest-672204617 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-422490691 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-422490691, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:22:33.291697 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-b5b79d63-e3b2-4833-95fd-ad29de995680 tempest-GroupSnapshotsTest-672204617 None] Created reservations ['fa4b97e2-0ce9-4732-951d-9580c9d2a604', 'd2afb4ad-20fc-412a-bbe5-3585335e3893', '5d54b2a8-afc2-4fc3-85b4-c030c79316ac', '56f46530-2a57-4e3a-adfc-17dda83a2916'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:33.359290 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b5b79d63-e3b2-4833-95fd-ad29de995680 tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:33.380764 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-b5b79d63-e3b2-4833-95fd-ad29de995680 tempest-GroupSnapshotsTest-672204617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:33.403660 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-b5b79d63-e3b2-4833-95fd-ad29de995680 tempest-GroupSnapshotsTest-672204617 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:22:33.407639 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-b5b79d63-e3b2-4833-95fd-ad29de995680 tempest-GroupSnapshotsTest-672204617 None] Delete group completed successfully. Dec 11 21:22:37.323291 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-deac762c-0347-4904-a9b5-1655645216a6 tempest-GroupsV314Test-653952660 None] Group tempest-GroupsV314Test-Group-2032621826: creating Dec 11 21:22:37.338803 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-deac762c-0347-4904-a9b5-1655645216a6 tempest-GroupsV314Test-653952660 None] Group tempest-GroupsV314Test-Group-2032621826: created successfully Dec 11 21:22:37.347093 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-deac762c-0347-4904-a9b5-1655645216a6 tempest-GroupsV314Test-653952660 None] Create group completed successfully. Dec 11 21:22:38.692112 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:22:38.695286 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:22:38.695722 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:22:38.708458 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Flow 'volume_create_manager' (9eba3075-a138-4a3b-970b-27f050d2e35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:38.711708 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940cd6e9-79fc-4907-9ace-95f5d26d4a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:38.718764 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:22:38.731470 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940cd6e9-79fc-4907-9ace-95f5d26d4a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-866987625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cda322c2-a43b-4538-9cde-63fd0d9bea27,host='ncdv-master-1@ceph#ceph',id=c7b658d1-2124-4791-a3c0-7660dd3f1c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b45a09817ef45afa5e7dc65b373da3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:22:39Z,use_quota=True,user_id='a9785485f8bb46419c45e9f3333cb9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a76b2bea-518b-4ca6-a8c6-308e3027d185),volume_type_id=a76b2bea-518b-4ca6-a8c6-308e3027d185)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:38.734068 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e78461-b3e8-49bd-9ba7-5ddb66bbae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:38.736284 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e78461-b3e8-49bd-9ba7-5ddb66bbae94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:38.738748 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1916c138-8f1d-4df9-9db4-2920fb7ba62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:38.741012 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1916c138-8f1d-4df9-9db4-2920fb7ba62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b658d1-2124-4791-a3c0-7660dd3f1c8f', 'volume_name': 'volume-c7b658d1-2124-4791-a3c0-7660dd3f1c8f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:38.743400 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dc7fa9-e666-4935-8619-e9cab20358bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:38.745538 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dc7fa9-e666-4935-8619-e9cab20358bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:38.747801 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c86e54-3de1-4965-8be6-710506679ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:38.761480 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Volume c7b658d1-2124-4791-a3c0-7660dd3f1c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b658d1-2124-4791-a3c0-7660dd3f1c8f', 'volume_size': 1} Dec 11 21:22:38.761872 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] creating volume 'volume-c7b658d1-2124-4791-a3c0-7660dd3f1c8f' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:22:38.762876 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:38.812325 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] extra_specs: {} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:22:38.812692 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] extra_specs: {} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:22:38.814857 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c86e54-3de1-4965-8be6-710506679ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b658d1-2124-4791-a3c0-7660dd3f1c8f', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:38.817106 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be958cb3-37fe-4148-9ec3-4b166312ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:38.825939 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Volume volume-c7b658d1-2124-4791-a3c0-7660dd3f1c8f (c7b658d1-2124-4791-a3c0-7660dd3f1c8f): created successfully Dec 11 21:22:38.827839 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be958cb3-37fe-4148-9ec3-4b166312ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:38.830842 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Flow 'volume_create_manager' (9eba3075-a138-4a3b-970b-27f050d2e35e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:38.838790 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9311c1b7-670e-4f07-a95e-2532bf67cba3 tempest-GroupsV314Test-653952660 None] Created volume successfully. Dec 11 21:22:40.109308 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f3aa3c70-2b47-4173-8d4f-fd05d0bad858 tempest-GroupsV314Test-653952660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:40.156921 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f3aa3c70-2b47-4173-8d4f-fd05d0bad858 tempest-GroupsV314Test-653952660 None] creating snapshot='volume-ae5c7888-0d64-4cd2-ade3-b857b86a4a07.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:22:40.350362 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f3aa3c70-2b47-4173-8d4f-fd05d0bad858 tempest-GroupsV314Test-653952660 None] cloning 'volume-c7b658d1-2124-4791-a3c0-7660dd3f1c8f@volume-ae5c7888-0d64-4cd2-ade3-b857b86a4a07.clone_snap' to 'volume-ae5c7888-0d64-4cd2-ade3-b857b86a4a07' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:22:40.440885 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f3aa3c70-2b47-4173-8d4f-fd05d0bad858 tempest-GroupsV314Test-653952660 None] Volume volume-c7b658d1-2124-4791-a3c0-7660dd3f1c8f is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:22:40.445470 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f3aa3c70-2b47-4173-8d4f-fd05d0bad858 tempest-GroupsV314Test-653952660 None] extra_specs: {} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:22:40.445850 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f3aa3c70-2b47-4173-8d4f-fd05d0bad858 tempest-GroupsV314Test-653952660 None] extra_specs: {} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:22:40.461478 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f3aa3c70-2b47-4173-8d4f-fd05d0bad858 tempest-GroupsV314Test-653952660 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:22:40.501556 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f3aa3c70-2b47-4173-8d4f-fd05d0bad858 tempest-GroupsV314Test-653952660 None] Create group from source-group-cda322c2-a43b-4538-9cde-63fd0d9bea27 completed successfully. Dec 11 21:22:41.570652 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:41.625748 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:22:41.631798 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] deleting rbd volume volume-ae5c7888-0d64-4cd2-ade3-b857b86a4a07 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:22:41.792961 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:22:41.811578 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] Volume volume-c7b658d1-2124-4791-a3c0-7660dd3f1c8f is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:22:41.812148 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] deleting parent snapshot volume-ae5c7888-0d64-4cd2-ade3-b857b86a4a07.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:22:42.412135 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] Created reservations ['d34c75f9-a04d-44c3-80cc-cb366784f653'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:42.427253 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-707994407 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-707994407, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:22:42.427983 ncdv-master-1 cinder-volume[134173]: WARNING cinder.quota [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-707994407 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-707994407, it is now deprecated. Please use the default quota class for default quota. Dec 11 21:22:42.439937 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] Created reservations ['74eba828-02c7-4c53-a497-5a4f17126603', '93701176-f7aa-4869-bab2-906057bf2806', '42bc06e3-b4d9-4ea0-9980-489b9a5e9efb', 'acdf12d5-75ad-46fd-b8a5-593352aebed3'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:42.505747 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:42.528300 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:42.551090 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:22:42.555040 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-2c896639-7d47-4633-8d46-63b1e96f3f57 tempest-GroupsV314Test-653952660 None] Delete group completed successfully. Dec 11 21:22:42.839112 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1264655c-de30-4750-b798-498e4c75f7bd tempest-GroupsV314Test-653952660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:42.881407 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1264655c-de30-4750-b798-498e4c75f7bd tempest-GroupsV314Test-653952660 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:22:42.881970 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1264655c-de30-4750-b798-498e4c75f7bd tempest-GroupsV314Test-653952660 None] Volume volume-c7b658d1-2124-4791-a3c0-7660dd3f1c8f is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:22:42.889079 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1264655c-de30-4750-b798-498e4c75f7bd tempest-GroupsV314Test-653952660 None] deleting rbd volume volume-c7b658d1-2124-4791-a3c0-7660dd3f1c8f {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:22:43.094208 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-1264655c-de30-4750-b798-498e4c75f7bd tempest-GroupsV314Test-653952660 None] Created reservations ['8a322254-bf56-459e-810b-a71b184fd429'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:43.123452 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-1264655c-de30-4750-b798-498e4c75f7bd tempest-GroupsV314Test-653952660 None] Created reservations ['bda91617-291c-4bf7-8214-2f96d36f2e28', '6c6d5d1b-43b5-4da9-9d1b-2529d86ca822', '3a2fe679-5881-465c-902a-76d2556da9c6', '34b8c92f-5697-45bd-a763-690d751e4f65'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:43.193957 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1264655c-de30-4750-b798-498e4c75f7bd tempest-GroupsV314Test-653952660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:43.216049 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1264655c-de30-4750-b798-498e4c75f7bd tempest-GroupsV314Test-653952660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:43.237917 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-1264655c-de30-4750-b798-498e4c75f7bd tempest-GroupsV314Test-653952660 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:22:43.241541 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1264655c-de30-4750-b798-498e4c75f7bd tempest-GroupsV314Test-653952660 None] Delete group completed successfully. Dec 11 21:22:52.208955 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:22:52.212740 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:22:52.213175 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:22:52.225483 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Flow 'volume_create_manager' (5887d32e-0a69-487d-843d-8d6921cc26f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:52.228708 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db416888-f728-4497-b5d8-9ca513c9fc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:52.234630 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:22:52.247845 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db416888-f728-4497-b5d8-9ca513c9fc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-868642853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2ed1e77e-3c7e-4007-a18c-fee17a8143b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbc1f6ba46fa439b88e809bce839fe9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:22:52Z,use_quota=True,user_id='c40c037169324dd9b91b50b1c8ed4dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:52.250414 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0314971a-39cc-4307-bd33-a1ed9052429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:52.252618 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0314971a-39cc-4307-bd33-a1ed9052429e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:52.255072 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54ccb2f-4953-44b7-b4c7-b7570c9bce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:52.257302 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54ccb2f-4953-44b7-b4c7-b7570c9bce3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ed1e77e-3c7e-4007-a18c-fee17a8143b9', 'volume_name': 'volume-2ed1e77e-3c7e-4007-a18c-fee17a8143b9', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:52.260524 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd70f28-fb10-4187-9745-4db454ecff59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:52.262256 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd70f28-fb10-4187-9745-4db454ecff59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:52.264492 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30646ddc-511e-4ffe-8a64-d0c5fc1ebf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:52.265253 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Volume 2ed1e77e-3c7e-4007-a18c-fee17a8143b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ed1e77e-3c7e-4007-a18c-fee17a8143b9', 'volume_size': 1} Dec 11 21:22:52.265657 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] creating volume 'volume-2ed1e77e-3c7e-4007-a18c-fee17a8143b9' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:22:52.266603 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:52.319486 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:22:52.319857 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:22:52.322495 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30646ddc-511e-4ffe-8a64-d0c5fc1ebf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed1e77e-3c7e-4007-a18c-fee17a8143b9', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:52.324687 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7550ed4e-003c-425b-957c-a5f9817fd9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:52.333236 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Volume volume-2ed1e77e-3c7e-4007-a18c-fee17a8143b9 (2ed1e77e-3c7e-4007-a18c-fee17a8143b9): created successfully Dec 11 21:22:52.335097 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7550ed4e-003c-425b-957c-a5f9817fd9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:52.338768 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Flow 'volume_create_manager' (5887d32e-0a69-487d-843d-8d6921cc26f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:52.346110 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-3de8ba74-15b4-49fc-8c0e-ab5761136d8a tempest-VolumesListAdminTestJSON-1668309033 None] Created volume successfully. Dec 11 21:22:53.607254 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:22:53.612193 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:22:53.612753 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:22:53.626700 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Flow 'volume_create_manager' (5fcbf978-b59f-497f-927c-bf0c863615f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:53.629883 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139d83ad-ac23-46e4-8f68-f9c022af1181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:53.636561 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:22:53.648652 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139d83ad-ac23-46e4-8f68-f9c022af1181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1475674719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=50f6151b-756e-4f2e-a146-5f6d058a63dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbc1f6ba46fa439b88e809bce839fe9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:22:54Z,use_quota=True,user_id='c40c037169324dd9b91b50b1c8ed4dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:53.651862 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0371256-a9b7-4d2f-9c5b-35c24b96e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:53.654009 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0371256-a9b7-4d2f-9c5b-35c24b96e675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:53.656475 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f048ad9-542c-4c8c-9b43-2e60430a1d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:53.658737 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f048ad9-542c-4c8c-9b43-2e60430a1d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f6151b-756e-4f2e-a146-5f6d058a63dd', 'volume_name': 'volume-50f6151b-756e-4f2e-a146-5f6d058a63dd', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:53.661060 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f2aa23-84f5-4d66-89b3-b4597ced1eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:53.663253 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f2aa23-84f5-4d66-89b3-b4597ced1eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:53.665562 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03343a86-978f-43fa-a9b5-4c54ec6f5531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:53.666332 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Volume 50f6151b-756e-4f2e-a146-5f6d058a63dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f6151b-756e-4f2e-a146-5f6d058a63dd', 'volume_size': 1} Dec 11 21:22:53.666740 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] creating volume 'volume-50f6151b-756e-4f2e-a146-5f6d058a63dd' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:22:53.667720 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:53.717633 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:22:53.717964 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:22:53.720354 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03343a86-978f-43fa-a9b5-4c54ec6f5531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f6151b-756e-4f2e-a146-5f6d058a63dd', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:53.722707 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287181e0-437e-4822-9c1d-dcb4383d90bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:53.731841 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Volume volume-50f6151b-756e-4f2e-a146-5f6d058a63dd (50f6151b-756e-4f2e-a146-5f6d058a63dd): created successfully Dec 11 21:22:53.733913 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287181e0-437e-4822-9c1d-dcb4383d90bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:53.736998 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Flow 'volume_create_manager' (5fcbf978-b59f-497f-927c-bf0c863615f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:53.744208 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-2f1e3aba-b76d-4c19-aa99-2d6839b462e0 tempest-VolumesListAdminTestJSON-1668309033 None] Created volume successfully. Dec 11 21:22:54.965961 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:22:54.969303 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:22:54.969746 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:22:54.983220 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Flow 'volume_create_manager' (881abb56-ba2b-4450-9da5-b5ae34e8909b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:54.986404 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c50b21e-3af7-4c2a-9ba6-c08d5e24f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:54.992872 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:22:55.005327 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c50b21e-3af7-4c2a-9ba6-c08d5e24f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-882549810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=916e2d16-6f68-4ffd-b4f6-b5d17c716574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbc1f6ba46fa439b88e809bce839fe9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:22:55Z,use_quota=True,user_id='c40c037169324dd9b91b50b1c8ed4dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:55.007982 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7af9576-02a9-4945-a55c-2fac313fb100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:55.010194 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7af9576-02a9-4945-a55c-2fac313fb100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:55.012642 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d891b4-2247-48fa-9669-6bd0b24cbf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:55.014951 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d891b4-2247-48fa-9669-6bd0b24cbf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '916e2d16-6f68-4ffd-b4f6-b5d17c716574', 'volume_name': 'volume-916e2d16-6f68-4ffd-b4f6-b5d17c716574', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:55.017286 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3d8e51-5efc-46bb-a9d5-12f88d28d9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:55.019484 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3d8e51-5efc-46bb-a9d5-12f88d28d9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:55.021711 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0643e67d-cb22-4f5c-b32d-f2e2a93515b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:55.022587 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Volume 916e2d16-6f68-4ffd-b4f6-b5d17c716574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-916e2d16-6f68-4ffd-b4f6-b5d17c716574', 'volume_size': 1} Dec 11 21:22:55.022898 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] creating volume 'volume-916e2d16-6f68-4ffd-b4f6-b5d17c716574' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:22:55.024371 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:55.079874 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:22:55.080170 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:22:55.082218 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0643e67d-cb22-4f5c-b32d-f2e2a93515b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916e2d16-6f68-4ffd-b4f6-b5d17c716574', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:55.084532 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b22bdfe-2453-4393-81f7-fe1642452977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:55.093675 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Volume volume-916e2d16-6f68-4ffd-b4f6-b5d17c716574 (916e2d16-6f68-4ffd-b4f6-b5d17c716574): created successfully Dec 11 21:22:55.095909 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b22bdfe-2453-4393-81f7-fe1642452977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:55.098913 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Flow 'volume_create_manager' (881abb56-ba2b-4450-9da5-b5ae34e8909b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:55.105711 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-824a9c71-4650-4330-81b3-fa32a79b457b tempest-VolumesListAdminTestJSON-1668309033 None] Created volume successfully. Dec 11 21:22:55.861739 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:22:55.862490 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:55.884552 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:55.910401 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:22:56.387615 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:22:56.390944 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:22:56.391385 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:22:56.404133 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Flow 'volume_create_manager' (d882083a-04c8-4780-b63b-e47853ebec31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:56.407362 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbe0b53-7b5f-4cc5-bdef-47e44531172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:56.413589 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:22:56.426679 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbe0b53-7b5f-4cc5-bdef-47e44531172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=399ca452-b668-4162-93bb-a9028ff1a5c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e63630bdcc44c7919f154fe3e44588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:22:56Z,use_quota=True,user_id='90092f884aa5498d899761c4075f326f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:56.429289 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4895c577-d348-4543-b053-c21fa11a6ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:56.431521 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4895c577-d348-4543-b053-c21fa11a6ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:56.433964 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bcec07-00c6-4a39-b623-7f0f8ce33446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:56.436270 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bcec07-00c6-4a39-b623-7f0f8ce33446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '399ca452-b668-4162-93bb-a9028ff1a5c9', 'volume_name': 'volume-399ca452-b668-4162-93bb-a9028ff1a5c9', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:56.438639 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41413fe1-ae01-46e5-b634-053a7f95cfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:56.440783 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41413fe1-ae01-46e5-b634-053a7f95cfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:56.443046 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67796c2-72dc-4750-91ed-c0a50aaece02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:56.443826 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Volume 399ca452-b668-4162-93bb-a9028ff1a5c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-399ca452-b668-4162-93bb-a9028ff1a5c9', 'volume_size': 1} Dec 11 21:22:56.444215 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] creating volume 'volume-399ca452-b668-4162-93bb-a9028ff1a5c9' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:22:56.445173 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:56.493465 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:22:56.493839 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:22:56.495945 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67796c2-72dc-4750-91ed-c0a50aaece02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-399ca452-b668-4162-93bb-a9028ff1a5c9', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:56.498162 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e88854a-eeff-427d-8ec6-0f048bfa28d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:22:56.506702 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Volume volume-399ca452-b668-4162-93bb-a9028ff1a5c9 (399ca452-b668-4162-93bb-a9028ff1a5c9): created successfully Dec 11 21:22:56.508636 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e88854a-eeff-427d-8ec6-0f048bfa28d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:22:56.511639 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Flow 'volume_create_manager' (d882083a-04c8-4780-b63b-e47853ebec31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:22:56.518803 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-13a17724-e6c4-4cf6-b4f1-4d609a1224b8 tempest-VolumesListAdminTestJSON-1824872310 None] Created volume successfully. Dec 11 21:22:57.499193 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-6d261ca0-d841-4154-ac5f-36a9f9af2e83 tempest-VolumesListAdminTestJSON-1824872310 None] Lock "b'cinder-399ca452-b668-4162-93bb-a9028ff1a5c9-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:22:57.524788 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6d261ca0-d841-4154-ac5f-36a9f9af2e83 tempest-VolumesListAdminTestJSON-1824872310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:57.586011 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6d261ca0-d841-4154-ac5f-36a9f9af2e83 tempest-VolumesListAdminTestJSON-1824872310 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:22:57.586994 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6d261ca0-d841-4154-ac5f-36a9f9af2e83 tempest-VolumesListAdminTestJSON-1824872310 None] Volume volume-399ca452-b668-4162-93bb-a9028ff1a5c9 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:22:57.594497 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6d261ca0-d841-4154-ac5f-36a9f9af2e83 tempest-VolumesListAdminTestJSON-1824872310 None] deleting rbd volume volume-399ca452-b668-4162-93bb-a9028ff1a5c9 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:22:57.608334 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-1d5b5162-5756-4f29-b5d9-4aed182dea88 tempest-VolumesListAdminTestJSON-1668309033 None] Lock "b'cinder-916e2d16-6f68-4ffd-b4f6-b5d17c716574-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:22:57.644609 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1d5b5162-5756-4f29-b5d9-4aed182dea88 tempest-VolumesListAdminTestJSON-1668309033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:57.695264 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1d5b5162-5756-4f29-b5d9-4aed182dea88 tempest-VolumesListAdminTestJSON-1668309033 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:22:57.696073 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1d5b5162-5756-4f29-b5d9-4aed182dea88 tempest-VolumesListAdminTestJSON-1668309033 None] Volume volume-916e2d16-6f68-4ffd-b4f6-b5d17c716574 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:22:57.707246 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1d5b5162-5756-4f29-b5d9-4aed182dea88 tempest-VolumesListAdminTestJSON-1668309033 None] deleting rbd volume volume-916e2d16-6f68-4ffd-b4f6-b5d17c716574 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:22:57.889729 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-6d261ca0-d841-4154-ac5f-36a9f9af2e83 tempest-VolumesListAdminTestJSON-1824872310 None] Created reservations ['308baca8-340a-42bd-8669-fe56c2b76716', '4cec0c11-c990-41b8-a3cc-63240dcb805b', '0d424def-3d5d-4900-b8c2-c6212ab29d65', '04684d8c-1e37-4734-874a-9e6599a49ee3'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:57.937395 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6d261ca0-d841-4154-ac5f-36a9f9af2e83 tempest-VolumesListAdminTestJSON-1824872310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:57.962520 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-6d261ca0-d841-4154-ac5f-36a9f9af2e83 tempest-VolumesListAdminTestJSON-1824872310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:57.991140 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-6d261ca0-d841-4154-ac5f-36a9f9af2e83 tempest-VolumesListAdminTestJSON-1824872310 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:22:57.996188 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-6d261ca0-d841-4154-ac5f-36a9f9af2e83 tempest-VolumesListAdminTestJSON-1824872310 None] Deleted volume successfully. Dec 11 21:22:58.016928 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-6d261ca0-d841-4154-ac5f-36a9f9af2e83 tempest-VolumesListAdminTestJSON-1824872310 None] Lock "b'cinder-399ca452-b668-4162-93bb-a9028ff1a5c9-delete_volume'" released by "delete_volume" :: held 0.518s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:22:58.043096 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-1d5b5162-5756-4f29-b5d9-4aed182dea88 tempest-VolumesListAdminTestJSON-1668309033 None] Created reservations ['37f3ed9e-8f17-4ec6-b720-97ae845b7eea', '70f1673b-a4bf-465b-b050-4235f8762acd', 'fa3d4f9c-8177-41d9-acb9-21d0c662f053', 'af88accb-cc22-4d94-857b-d75ba7f4cc38'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:58.081074 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1d5b5162-5756-4f29-b5d9-4aed182dea88 tempest-VolumesListAdminTestJSON-1668309033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:58.103460 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1d5b5162-5756-4f29-b5d9-4aed182dea88 tempest-VolumesListAdminTestJSON-1668309033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:58.125587 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-1d5b5162-5756-4f29-b5d9-4aed182dea88 tempest-VolumesListAdminTestJSON-1668309033 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:22:58.129553 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1d5b5162-5756-4f29-b5d9-4aed182dea88 tempest-VolumesListAdminTestJSON-1668309033 None] Deleted volume successfully. Dec 11 21:22:58.142685 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-1d5b5162-5756-4f29-b5d9-4aed182dea88 tempest-VolumesListAdminTestJSON-1668309033 None] Lock "b'cinder-916e2d16-6f68-4ffd-b4f6-b5d17c716574-delete_volume'" released by "delete_volume" :: held 0.534s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:22:58.676489 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-eae2624c-85bf-44d6-a53f-91c6875a91ea tempest-VolumesListAdminTestJSON-1668309033 None] Lock "b'cinder-50f6151b-756e-4f2e-a146-5f6d058a63dd-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:22:58.713924 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eae2624c-85bf-44d6-a53f-91c6875a91ea tempest-VolumesListAdminTestJSON-1668309033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:58.763156 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eae2624c-85bf-44d6-a53f-91c6875a91ea tempest-VolumesListAdminTestJSON-1668309033 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:22:58.763729 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eae2624c-85bf-44d6-a53f-91c6875a91ea tempest-VolumesListAdminTestJSON-1668309033 None] Volume volume-50f6151b-756e-4f2e-a146-5f6d058a63dd is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:22:58.770634 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eae2624c-85bf-44d6-a53f-91c6875a91ea tempest-VolumesListAdminTestJSON-1668309033 None] deleting rbd volume volume-50f6151b-756e-4f2e-a146-5f6d058a63dd {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:22:58.983269 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-eae2624c-85bf-44d6-a53f-91c6875a91ea tempest-VolumesListAdminTestJSON-1668309033 None] Created reservations ['7deb642e-b650-4ee0-9906-554e493bf541', 'da6d3c20-d58f-40ae-bd41-e0b7888f7c06', '3ee5ae36-96a6-421e-ab7f-18ee4bcd8f05', 'e31a2681-115c-4269-b6fb-1687729a7fd0'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:22:59.024396 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eae2624c-85bf-44d6-a53f-91c6875a91ea tempest-VolumesListAdminTestJSON-1668309033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:59.060142 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-eae2624c-85bf-44d6-a53f-91c6875a91ea tempest-VolumesListAdminTestJSON-1668309033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:59.084997 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-eae2624c-85bf-44d6-a53f-91c6875a91ea tempest-VolumesListAdminTestJSON-1668309033 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:22:59.089351 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-eae2624c-85bf-44d6-a53f-91c6875a91ea tempest-VolumesListAdminTestJSON-1668309033 None] Deleted volume successfully. Dec 11 21:22:59.102987 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-eae2624c-85bf-44d6-a53f-91c6875a91ea tempest-VolumesListAdminTestJSON-1668309033 None] Lock "b'cinder-50f6151b-756e-4f2e-a146-5f6d058a63dd-delete_volume'" released by "delete_volume" :: held 0.426s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:22:59.794841 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7b47b717-e725-4912-9816-484842710bd6 tempest-VolumesListAdminTestJSON-1668309033 None] Lock "b'cinder-2ed1e77e-3c7e-4007-a18c-fee17a8143b9-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:22:59.824027 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7b47b717-e725-4912-9816-484842710bd6 tempest-VolumesListAdminTestJSON-1668309033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:22:59.863279 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7b47b717-e725-4912-9816-484842710bd6 tempest-VolumesListAdminTestJSON-1668309033 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:22:59.863703 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7b47b717-e725-4912-9816-484842710bd6 tempest-VolumesListAdminTestJSON-1668309033 None] Volume volume-2ed1e77e-3c7e-4007-a18c-fee17a8143b9 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:22:59.869116 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7b47b717-e725-4912-9816-484842710bd6 tempest-VolumesListAdminTestJSON-1668309033 None] deleting rbd volume volume-2ed1e77e-3c7e-4007-a18c-fee17a8143b9 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:23:00.065445 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-7b47b717-e725-4912-9816-484842710bd6 tempest-VolumesListAdminTestJSON-1668309033 None] Created reservations ['5a792430-bf7a-4ced-a6c7-c2ffa9bdf494', '563af501-8a05-4c19-a8c4-624e1a709b0d', '6809bdc5-9b9f-4c65-b09c-07319dd68303', '31686bb2-e1a1-42d8-ae10-8ac0d6191f66'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:23:00.103662 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7b47b717-e725-4912-9816-484842710bd6 tempest-VolumesListAdminTestJSON-1668309033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:00.125333 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7b47b717-e725-4912-9816-484842710bd6 tempest-VolumesListAdminTestJSON-1668309033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:00.149053 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7b47b717-e725-4912-9816-484842710bd6 tempest-VolumesListAdminTestJSON-1668309033 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:23:00.153496 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7b47b717-e725-4912-9816-484842710bd6 tempest-VolumesListAdminTestJSON-1668309033 None] Deleted volume successfully. Dec 11 21:23:00.165325 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7b47b717-e725-4912-9816-484842710bd6 tempest-VolumesListAdminTestJSON-1668309033 None] Lock "b'cinder-2ed1e77e-3c7e-4007-a18c-fee17a8143b9-delete_volume'" released by "delete_volume" :: held 0.371s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:23:03.122127 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:23:03.125491 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:23:03.125850 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:23:03.137909 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Flow 'volume_create_manager' (b5c771f7-7c51-4855-a7f8-4667b6bd7644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:03.141061 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b4abf7-9f09-427d-937d-4b6c99f102b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:03.147057 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:23:03.159793 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b4abf7-9f09-427d-937d-4b6c99f102b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-331543635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c91a9a74-a7d0-4006-9f18-589c5f96cdf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3c73cc75a74c32a6fbd72543058b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:23:03Z,use_quota=True,user_id='39549f38e2a14204b703fa4ccc85247a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:03.162618 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de40ad76-d4c6-439b-91b0-9ea382a1b5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:03.165427 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de40ad76-d4c6-439b-91b0-9ea382a1b5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:03.167859 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917a19d7-ce47-494c-b275-8a30aebca15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:03.170126 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917a19d7-ce47-494c-b275-8a30aebca15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91a9a74-a7d0-4006-9f18-589c5f96cdf4', 'volume_name': 'volume-c91a9a74-a7d0-4006-9f18-589c5f96cdf4', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:03.172464 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8950c8-b2c2-47fc-8f97-c968c6c6c687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:03.174599 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8950c8-b2c2-47fc-8f97-c968c6c6c687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:03.176832 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b44d6f-c7b9-4d54-80dc-fc615875fa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:03.177594 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Volume c91a9a74-a7d0-4006-9f18-589c5f96cdf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91a9a74-a7d0-4006-9f18-589c5f96cdf4', 'volume_size': 1} Dec 11 21:23:03.178080 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] creating volume 'volume-c91a9a74-a7d0-4006-9f18-589c5f96cdf4' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:23:03.179053 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:03.227694 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:23:03.228064 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:23:03.230081 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b44d6f-c7b9-4d54-80dc-fc615875fa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91a9a74-a7d0-4006-9f18-589c5f96cdf4', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:03.232362 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7993372-6771-46c7-b867-06bd989406fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:03.240499 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Volume volume-c91a9a74-a7d0-4006-9f18-589c5f96cdf4 (c91a9a74-a7d0-4006-9f18-589c5f96cdf4): created successfully Dec 11 21:23:03.242343 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7993372-6771-46c7-b867-06bd989406fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:03.245289 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Flow 'volume_create_manager' (b5c771f7-7c51-4855-a7f8-4667b6bd7644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:03.252619 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-18863171-304a-4169-ba82-ed170f0beebb tempest-VolumesBackupsTest-846679880 None] Created volume successfully. Dec 11 21:23:14.780125 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-68510cf9-9497-418b-8ee4-d1c4aa11b6e5 req-0da2bb7a-a9a3-49e2-a633-9a59daea04d4 tempest-VolumesBackupsTest-846679880 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:23:15.477441 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-68510cf9-9497-418b-8ee4-d1c4aa11b6e5 req-0da2bb7a-a9a3-49e2-a633-9a59daea04d4 tempest-VolumesBackupsTest-846679880 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.697s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:23:15.478414 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-68510cf9-9497-418b-8ee4-d1c4aa11b6e5 req-0da2bb7a-a9a3-49e2-a633-9a59daea04d4 tempest-VolumesBackupsTest-846679880 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c91a9a74-a7d0-4006-9f18-589c5f96cdf4', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'c91a9a74-a7d0-4006-9f18-589c5f96cdf4', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:23:15.532465 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-68510cf9-9497-418b-8ee4-d1c4aa11b6e5 req-0da2bb7a-a9a3-49e2-a633-9a59daea04d4 tempest-VolumesBackupsTest-846679880 None] Connection info returned from driver {'name': 'volumes/volume-c91a9a74-a7d0-4006-9f18-589c5f96cdf4', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c91a9a74-a7d0-4006-9f18-589c5f96cdf4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e5319e61-d249-494d-be3d-b3c666fbc97b'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:23:15.578593 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-68510cf9-9497-418b-8ee4-d1c4aa11b6e5 req-0da2bb7a-a9a3-49e2-a633-9a59daea04d4 tempest-VolumesBackupsTest-846679880 None] attachment_update completed successfully. Dec 11 21:23:18.132203 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-001c9e7c-ed13-4689-9d7f-78c15000dfbb tempest-VolumesBackupsTest-846679880 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:23:18.801325 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-001c9e7c-ed13-4689-9d7f-78c15000dfbb tempest-VolumesBackupsTest-846679880 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.669s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:23:18.802098 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-001c9e7c-ed13-4689-9d7f-78c15000dfbb tempest-VolumesBackupsTest-846679880 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c91a9a74-a7d0-4006-9f18-589c5f96cdf4', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'c91a9a74-a7d0-4006-9f18-589c5f96cdf4', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:23:18.816997 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-001c9e7c-ed13-4689-9d7f-78c15000dfbb tempest-VolumesBackupsTest-846679880 None] Initialize volume connection completed successfully. Dec 11 21:23:20.489308 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-001c9e7c-ed13-4689-9d7f-78c15000dfbb tempest-VolumesBackupsTest-846679880 None] Terminate volume connection completed successfully. Dec 11 21:23:20.504958 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-001c9e7c-ed13-4689-9d7f-78c15000dfbb tempest-VolumesBackupsTest-846679880 None] Remove volume export completed successfully. Dec 11 21:23:22.968448 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-b5ccf57f-9f76-487f-9828-0098b5fb461c req-b2467786-c4a6-404e-abf1-4f382bc029f3 tempest-VolumesBackupsTest-846679880 None] Terminate volume connection completed successfully. Dec 11 21:23:22.969073 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-b5ccf57f-9f76-487f-9828-0098b5fb461c req-b2467786-c4a6-404e-abf1-4f382bc029f3 tempest-VolumesBackupsTest-846679880 None] Deleting attachment e5319e61-d249-494d-be3d-b3c666fbc97b. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:23:27.075492 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-07cce73f-ed1c-4f67-9018-fa27728bcfc9 tempest-VolumesBackupsTest-846679880 None] Lock "b'cinder-c91a9a74-a7d0-4006-9f18-589c5f96cdf4-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:23:27.109522 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-07cce73f-ed1c-4f67-9018-fa27728bcfc9 tempest-VolumesBackupsTest-846679880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:27.756078 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-07cce73f-ed1c-4f67-9018-fa27728bcfc9 tempest-VolumesBackupsTest-846679880 None] Volume volume-c91a9a74-a7d0-4006-9f18-589c5f96cdf4 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:23:27.769586 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-07cce73f-ed1c-4f67-9018-fa27728bcfc9 tempest-VolumesBackupsTest-846679880 None] deleting rbd volume volume-c91a9a74-a7d0-4006-9f18-589c5f96cdf4 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:23:27.964004 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-07cce73f-ed1c-4f67-9018-fa27728bcfc9 tempest-VolumesBackupsTest-846679880 None] Created reservations ['082df429-2fe9-4177-86e4-511f057a250f', '66fef8e4-7e15-4623-80a5-00a9c80f0a31', '19eb3bd7-dfc0-4c0b-a658-b38da594d6c2', 'ca8a7474-f7d5-4bd4-96a4-84519964e7bb'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:23:28.008566 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-07cce73f-ed1c-4f67-9018-fa27728bcfc9 tempest-VolumesBackupsTest-846679880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:28.031346 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-07cce73f-ed1c-4f67-9018-fa27728bcfc9 tempest-VolumesBackupsTest-846679880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:28.053489 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-07cce73f-ed1c-4f67-9018-fa27728bcfc9 tempest-VolumesBackupsTest-846679880 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:23:28.058331 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-07cce73f-ed1c-4f67-9018-fa27728bcfc9 tempest-VolumesBackupsTest-846679880 None] Deleted volume successfully. Dec 11 21:23:28.070057 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-07cce73f-ed1c-4f67-9018-fa27728bcfc9 tempest-VolumesBackupsTest-846679880 None] Lock "b'cinder-c91a9a74-a7d0-4006-9f18-589c5f96cdf4-delete_volume'" released by "delete_volume" :: held 0.995s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:23:28.567830 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:23:28.571513 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:23:28.571998 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:23:28.584593 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Flow 'volume_create_manager' (e041f112-059c-49c6-9d34-7805ef7732ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:28.588491 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2233bb-4d90-4260-8a60-af2684ef3fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:28.595194 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:23:28.607825 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2233bb-4d90-4260-8a60-af2684ef3fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1221699227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8584d382-fe1d-46c6-b7b7-1345dee565bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3c73cc75a74c32a6fbd72543058b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:23:29Z,use_quota=True,user_id='39549f38e2a14204b703fa4ccc85247a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:28.610608 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845cdbbe-5121-4dbc-90e2-6cadfa6caf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:28.612790 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845cdbbe-5121-4dbc-90e2-6cadfa6caf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:28.615301 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2efdded-b2e6-4d8d-a06e-4e0121d9b664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:28.692801 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2efdded-b2e6-4d8d-a06e-4e0121d9b664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8584d382-fe1d-46c6-b7b7-1345dee565bb', 'volume_name': 'volume-8584d382-fe1d-46c6-b7b7-1345dee565bb', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:28.695254 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff64cc74-4fc5-43e6-99b4-71d06dd1e4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:28.697470 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff64cc74-4fc5-43e6-99b4-71d06dd1e4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:28.699725 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4741d900-f15e-429f-8abe-3cf818cf18ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:28.700576 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Volume 8584d382-fe1d-46c6-b7b7-1345dee565bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8584d382-fe1d-46c6-b7b7-1345dee565bb', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 21:23:28.701136 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Cloning 8584d382-fe1d-46c6-b7b7-1345dee565bb from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 21:23:28.709485 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:23:28.719537 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 23, 28, 713981)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:23:28.720412 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:23:28.720903 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 21:23:28.725125 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:23:28.726645 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 21:23:28.732721 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 23, 28, 730404)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:23:28.733155 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:23:28.733596 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 21:23:28.744882 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:28.795102 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] creating snapshot='volume-8584d382-fe1d-46c6-b7b7-1345dee565bb.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:23:29.779607 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-8584d382-fe1d-46c6-b7b7-1345dee565bb.clone_snap' to 'volume-8584d382-fe1d-46c6-b7b7-1345dee565bb' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:23:29.902859 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:23:29.904007 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:23:29.904382 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:23:29.921412 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:23:29.922021 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Marking volume 8584d382-fe1d-46c6-b7b7-1345dee565bb as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:23:29.929899 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to 8584d382-fe1d-46c6-b7b7-1345dee565bb. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 21:23:29.930326 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Creating volume glance metadata for volume 8584d382-fe1d-46c6-b7b7-1345dee565bb backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 21:23:29.977528 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4741d900-f15e-429f-8abe-3cf818cf18ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8584d382-fe1d-46c6-b7b7-1345dee565bb', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:29.979981 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1489b1-3796-4144-bbf5-486563be13c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:29.987931 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Volume volume-8584d382-fe1d-46c6-b7b7-1345dee565bb (8584d382-fe1d-46c6-b7b7-1345dee565bb): created successfully Dec 11 21:23:29.990419 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1489b1-3796-4144-bbf5-486563be13c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:29.994079 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Flow 'volume_create_manager' (e041f112-059c-49c6-9d34-7805ef7732ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:30.001470 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-5dc38993-3d90-44db-ab42-4f6f1c7ca36e tempest-VolumesBackupsTest-846679880 None] Created volume successfully. Dec 11 21:23:30.913654 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-635b8799-8414-41cf-a116-ec646e41d400 tempest-VolumesBackupsTest-846679880 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:23:31.557467 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-635b8799-8414-41cf-a116-ec646e41d400 tempest-VolumesBackupsTest-846679880 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.643s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:23:31.558104 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-635b8799-8414-41cf-a116-ec646e41d400 tempest-VolumesBackupsTest-846679880 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8584d382-fe1d-46c6-b7b7-1345dee565bb', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '8584d382-fe1d-46c6-b7b7-1345dee565bb', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:23:31.570596 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-635b8799-8414-41cf-a116-ec646e41d400 tempest-VolumesBackupsTest-846679880 None] Initialize volume connection completed successfully. Dec 11 21:23:36.159677 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-635b8799-8414-41cf-a116-ec646e41d400 tempest-VolumesBackupsTest-846679880 None] Terminate volume connection completed successfully. Dec 11 21:23:36.178310 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-635b8799-8414-41cf-a116-ec646e41d400 tempest-VolumesBackupsTest-846679880 None] Remove volume export completed successfully. Dec 11 21:23:36.566463 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-6e0f8eca-d693-4bce-9d93-187668e5e501 req-f00bbc86-dda4-4045-8df7-55299fac223c tempest-TestVolumeBootPattern-909971433 None] Terminate volume connection completed successfully. Dec 11 21:23:36.567088 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-6e0f8eca-d693-4bce-9d93-187668e5e501 req-f00bbc86-dda4-4045-8df7-55299fac223c tempest-TestVolumeBootPattern-909971433 None] Deleting attachment 7d8a96cd-480c-4171-841b-495efb4401dd. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:23:37.317674 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:23:37.322123 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:23:37.322780 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:23:37.338493 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Flow 'volume_create_manager' (69625b65-cf29-417f-883e-82ecedf97bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:37.341812 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc91c284-722b-4ab9-97c0-ddf5cd373d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:37.348686 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:23:37.362199 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc91c284-722b-4ab9-97c0-ddf5cd373d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:23:37Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_5d4e07e5-41a5-4ed5-b597-1a8352d12130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=99280ea9-5635-4ba2-a906-d30233819d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3c73cc75a74c32a6fbd72543058b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:23:37Z,use_quota=True,user_id='39549f38e2a14204b703fa4ccc85247a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:37.364900 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cc04a9-6d06-4332-a864-fbc982d113a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:37.367286 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cc04a9-6d06-4332-a864-fbc982d113a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:37.370248 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ae1394-75b1-421d-887b-5c2277c353de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:37.372585 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ae1394-75b1-421d-887b-5c2277c353de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99280ea9-5635-4ba2-a906-d30233819d72', 'volume_name': 'volume-99280ea9-5635-4ba2-a906-d30233819d72', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:37.374965 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14776024-7ca4-41f3-b541-35cf5911e08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:37.377137 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14776024-7ca4-41f3-b541-35cf5911e08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:37.379457 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2e861d-13a7-4c2e-bed1-630d26d7857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:37.380270 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Volume 99280ea9-5635-4ba2-a906-d30233819d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99280ea9-5635-4ba2-a906-d30233819d72', 'volume_size': 1} Dec 11 21:23:37.380677 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] creating volume 'volume-99280ea9-5635-4ba2-a906-d30233819d72' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:23:37.381798 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:37.437245 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:23:37.437752 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:23:37.439929 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2e861d-13a7-4c2e-bed1-630d26d7857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99280ea9-5635-4ba2-a906-d30233819d72', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:37.442284 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c318b9-6932-4973-9fc6-681147c9e8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:37.451427 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Volume volume-99280ea9-5635-4ba2-a906-d30233819d72 (99280ea9-5635-4ba2-a906-d30233819d72): created successfully Dec 11 21:23:37.453647 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c318b9-6932-4973-9fc6-681147c9e8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:37.456896 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Flow 'volume_create_manager' (69625b65-cf29-417f-883e-82ecedf97bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:37.466107 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Created volume successfully. Dec 11 21:23:38.401395 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:23:39.051585 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.650s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:23:39.052368 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-99280ea9-5635-4ba2-a906-d30233819d72', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '99280ea9-5635-4ba2-a906-d30233819d72', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:23:39.067717 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Initialize volume connection completed successfully. Dec 11 21:23:39.492846 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-2319ec87-a62b-470a-b455-3601b78b9024 req-b3000a0a-e727-451c-afcb-f2d9ceefe2c7 tempest-TestVolumeBootPattern-909971433 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:23:40.336602 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-2319ec87-a62b-470a-b455-3601b78b9024 req-b3000a0a-e727-451c-afcb-f2d9ceefe2c7 tempest-TestVolumeBootPattern-909971433 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.844s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:23:40.337619 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-2319ec87-a62b-470a-b455-3601b78b9024 req-b3000a0a-e727-451c-afcb-f2d9ceefe2c7 tempest-TestVolumeBootPattern-909971433 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '2f8227b8-bd5e-456e-866f-fd0bf6c93d27', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:23:40.392631 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-2319ec87-a62b-470a-b455-3601b78b9024 req-b3000a0a-e727-451c-afcb-f2d9ceefe2c7 tempest-TestVolumeBootPattern-909971433 None] Connection info returned from driver {'name': 'volumes/volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2f8227b8-bd5e-456e-866f-fd0bf6c93d27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0c341d4d-f169-4099-9356-e7f6c3dfe909'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:23:40.493219 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-2319ec87-a62b-470a-b455-3601b78b9024 req-b3000a0a-e727-451c-afcb-f2d9ceefe2c7 tempest-TestVolumeBootPattern-909971433 None] attachment_update completed successfully. Dec 11 21:23:43.436198 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Terminate volume connection completed successfully. Dec 11 21:23:43.454125 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-4308be78-9a7b-4c96-922c-17529ceb905f tempest-VolumesBackupsTest-846679880 None] Remove volume export completed successfully. Dec 11 21:23:44.662832 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c81603ce-6d70-4b78-b592-c8b6bfab18c7 tempest-VolumesBackupsTest-846679880 None] Lock "b'cinder-99280ea9-5635-4ba2-a906-d30233819d72-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:23:44.703094 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c81603ce-6d70-4b78-b592-c8b6bfab18c7 tempest-VolumesBackupsTest-846679880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:45.209357 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c81603ce-6d70-4b78-b592-c8b6bfab18c7 tempest-VolumesBackupsTest-846679880 None] Volume volume-99280ea9-5635-4ba2-a906-d30233819d72 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:23:45.236638 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c81603ce-6d70-4b78-b592-c8b6bfab18c7 tempest-VolumesBackupsTest-846679880 None] deleting rbd volume volume-99280ea9-5635-4ba2-a906-d30233819d72 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:23:45.922626 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-c81603ce-6d70-4b78-b592-c8b6bfab18c7 tempest-VolumesBackupsTest-846679880 None] Created reservations ['6bd5b461-59b4-454a-8c52-112302dbe133', '22708aed-f67f-4e56-a15f-7e3e5cb1d414', '5ced7206-23db-4e91-a2b7-bbd86284c076', '7d7c6799-ae69-401c-855f-a7e72263ba3d'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:23:45.974127 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c81603ce-6d70-4b78-b592-c8b6bfab18c7 tempest-VolumesBackupsTest-846679880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:46.004831 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-c81603ce-6d70-4b78-b592-c8b6bfab18c7 tempest-VolumesBackupsTest-846679880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:46.042927 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-c81603ce-6d70-4b78-b592-c8b6bfab18c7 tempest-VolumesBackupsTest-846679880 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:23:46.047596 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-c81603ce-6d70-4b78-b592-c8b6bfab18c7 tempest-VolumesBackupsTest-846679880 None] Deleted volume successfully. Dec 11 21:23:46.060408 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-c81603ce-6d70-4b78-b592-c8b6bfab18c7 tempest-VolumesBackupsTest-846679880 None] Lock "b'cinder-99280ea9-5635-4ba2-a906-d30233819d72-delete_volume'" released by "delete_volume" :: held 1.398s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:23:47.932308 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-de4f844b-ae14-4fda-a4fd-be64c1210a97 tempest-VolumesBackupsTest-846679880 None] Lock "b'cinder-8584d382-fe1d-46c6-b7b7-1345dee565bb-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:23:47.971909 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-de4f844b-ae14-4fda-a4fd-be64c1210a97 tempest-VolumesBackupsTest-846679880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:48.255344 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-de4f844b-ae14-4fda-a4fd-be64c1210a97 tempest-VolumesBackupsTest-846679880 None] deleting rbd volume volume-8584d382-fe1d-46c6-b7b7-1345dee565bb {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:23:48.472447 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-de4f844b-ae14-4fda-a4fd-be64c1210a97 tempest-VolumesBackupsTest-846679880 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:23:48.513790 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-de4f844b-ae14-4fda-a4fd-be64c1210a97 tempest-VolumesBackupsTest-846679880 None] deleting parent snapshot volume-8584d382-fe1d-46c6-b7b7-1345dee565bb.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:23:49.481855 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-de4f844b-ae14-4fda-a4fd-be64c1210a97 tempest-VolumesBackupsTest-846679880 None] Created reservations ['2c486e59-c0bf-49a1-ada3-975b951203a5', '1f0801cc-42b3-4f5d-b344-878530969114', '1acc6c44-5d50-4a83-a2a8-55f6807bcc63', '47b551b4-b230-48b6-8050-db329d98f2a3'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:23:49.549759 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-de4f844b-ae14-4fda-a4fd-be64c1210a97 tempest-VolumesBackupsTest-846679880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:49.596312 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-de4f844b-ae14-4fda-a4fd-be64c1210a97 tempest-VolumesBackupsTest-846679880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:49.650125 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-de4f844b-ae14-4fda-a4fd-be64c1210a97 tempest-VolumesBackupsTest-846679880 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:23:49.655460 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-de4f844b-ae14-4fda-a4fd-be64c1210a97 tempest-VolumesBackupsTest-846679880 None] Deleted volume successfully. Dec 11 21:23:49.676768 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-de4f844b-ae14-4fda-a4fd-be64c1210a97 tempest-VolumesBackupsTest-846679880 None] Lock "b'cinder-8584d382-fe1d-46c6-b7b7-1345dee565bb-delete_volume'" released by "delete_volume" :: held 1.743s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:23:52.159239 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:23:52.164163 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:23:52.166630 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:23:52.189474 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Flow 'volume_create_manager' (71fb094e-9f56-4195-8ec3-d68514c15f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:52.195025 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1394a6-a0e8-45ff-849c-04dd1da72a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:52.202643 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:23:52.215988 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1394a6-a0e8-45ff-849c-04dd1da72a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-550617956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a6b986b9-a8a2-4f80-803b-73ba2db21b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024d5bac6ff34c9982053a4f55b41cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:23:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:23:52Z,use_quota=True,user_id='34df6f41e100472087cdd8c93de070e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:52.218660 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3adb5c7d-2357-4233-b7a5-503ec8f0268b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:52.222030 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3adb5c7d-2357-4233-b7a5-503ec8f0268b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:52.225112 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe470b9-2479-494b-adc1-894d0e0dc8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:52.228130 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe470b9-2479-494b-adc1-894d0e0dc8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6b986b9-a8a2-4f80-803b-73ba2db21b42', 'volume_name': 'volume-a6b986b9-a8a2-4f80-803b-73ba2db21b42', 'volume_size': 2}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:52.230528 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7af2be-f396-45f5-86c1-181de3b51b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:52.232676 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7af2be-f396-45f5-86c1-181de3b51b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:52.235855 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246453a0-92ca-4ab7-987f-4aa7a5fd3931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:52.236667 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Volume a6b986b9-a8a2-4f80-803b-73ba2db21b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6b986b9-a8a2-4f80-803b-73ba2db21b42', 'volume_size': 2} Dec 11 21:23:52.237223 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] creating volume 'volume-a6b986b9-a8a2-4f80-803b-73ba2db21b42' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:23:52.238587 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:52.349843 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:23:52.350769 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:23:52.353769 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246453a0-92ca-4ab7-987f-4aa7a5fd3931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b986b9-a8a2-4f80-803b-73ba2db21b42', 'volume_size': 2}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:52.355985 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a11421c-03b9-4a1e-9552-e8a342239f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:52.366236 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Volume volume-a6b986b9-a8a2-4f80-803b-73ba2db21b42 (a6b986b9-a8a2-4f80-803b-73ba2db21b42): created successfully Dec 11 21:23:52.370098 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a11421c-03b9-4a1e-9552-e8a342239f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:52.373827 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Flow 'volume_create_manager' (71fb094e-9f56-4195-8ec3-d68514c15f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:52.383033 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-3769b9a4-8def-44ed-97fa-26e900612ff9 tempest-VolumesCloneNegativeTest-548181809 None] Created volume successfully. Dec 11 21:23:53.275221 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-a0c1e64f-7ee1-44c0-b5cd-51a3ab242cb2 tempest-VolumesCloneNegativeTest-548181809 None] Lock "b'cinder-a6b986b9-a8a2-4f80-803b-73ba2db21b42-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:23:53.323217 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a0c1e64f-7ee1-44c0-b5cd-51a3ab242cb2 tempest-VolumesCloneNegativeTest-548181809 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:53.411698 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a0c1e64f-7ee1-44c0-b5cd-51a3ab242cb2 tempest-VolumesCloneNegativeTest-548181809 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:23:53.412464 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a0c1e64f-7ee1-44c0-b5cd-51a3ab242cb2 tempest-VolumesCloneNegativeTest-548181809 None] Volume volume-a6b986b9-a8a2-4f80-803b-73ba2db21b42 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:23:53.422078 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a0c1e64f-7ee1-44c0-b5cd-51a3ab242cb2 tempest-VolumesCloneNegativeTest-548181809 None] deleting rbd volume volume-a6b986b9-a8a2-4f80-803b-73ba2db21b42 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:23:53.678002 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-a0c1e64f-7ee1-44c0-b5cd-51a3ab242cb2 tempest-VolumesCloneNegativeTest-548181809 None] Created reservations ['87212419-ffef-490c-856d-d3f4409618d9', 'd70eed0b-229a-44ab-9929-2cf8f939a0eb', '57377266-0e84-4669-a527-8c1e1d4ed2d0', 'fbad03a2-b1f0-4211-a6ca-24fa3885244f'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:23:53.729002 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a0c1e64f-7ee1-44c0-b5cd-51a3ab242cb2 tempest-VolumesCloneNegativeTest-548181809 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:53.763846 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-a0c1e64f-7ee1-44c0-b5cd-51a3ab242cb2 tempest-VolumesCloneNegativeTest-548181809 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:53.793135 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-a0c1e64f-7ee1-44c0-b5cd-51a3ab242cb2 tempest-VolumesCloneNegativeTest-548181809 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:23:53.797206 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-a0c1e64f-7ee1-44c0-b5cd-51a3ab242cb2 tempest-VolumesCloneNegativeTest-548181809 None] Deleted volume successfully. Dec 11 21:23:53.811705 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-a0c1e64f-7ee1-44c0-b5cd-51a3ab242cb2 tempest-VolumesCloneNegativeTest-548181809 None] Lock "b'cinder-a6b986b9-a8a2-4f80-803b-73ba2db21b42-delete_volume'" released by "delete_volume" :: held 0.537s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:23:55.866310 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:23:55.868413 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:55.926279 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:55.965200 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:23:56.557311 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:23:56.560660 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:23:56.561100 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:23:56.573718 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Flow 'volume_create_manager' (f86ff677-9bb1-4601-9abf-a3f56d917304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:56.576977 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1327965e-df1a-4d74-baa1-efe27a1eb397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:56.583632 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:23:56.596741 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1327965e-df1a-4d74-baa1-efe27a1eb397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2044206157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5b5ab0b0-8c09-4846-8148-703817734fc8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08af2b1ed42b4317a4ae83f340d5091f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:23:57Z,use_quota=True,user_id='36919347daf344d0890db26dd91171d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:56.599371 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29620f38-5972-4369-b454-38826921f525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:56.602134 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29620f38-5972-4369-b454-38826921f525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:56.604594 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321f14f8-77b1-4b44-ac99-becb826ec5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:56.606882 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321f14f8-77b1-4b44-ac99-becb826ec5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b5ab0b0-8c09-4846-8148-703817734fc8', 'volume_name': 'volume-5b5ab0b0-8c09-4846-8148-703817734fc8', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:56.609204 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0cccfd-a58c-4f0f-9a1a-dff90fa57bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:56.611354 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0cccfd-a58c-4f0f-9a1a-dff90fa57bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:56.613566 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90cdf0a3-61e8-4fea-85ee-f0e6ac815bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:56.614343 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Volume 5b5ab0b0-8c09-4846-8148-703817734fc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b5ab0b0-8c09-4846-8148-703817734fc8', 'volume_size': 1} Dec 11 21:23:56.614751 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] creating volume 'volume-5b5ab0b0-8c09-4846-8148-703817734fc8' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:23:56.615729 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:56.676328 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:23:56.676658 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:23:56.678725 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90cdf0a3-61e8-4fea-85ee-f0e6ac815bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b5ab0b0-8c09-4846-8148-703817734fc8', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:56.681597 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadf05e3-686d-4e6b-b7c0-54269b864309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:56.691308 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Volume volume-5b5ab0b0-8c09-4846-8148-703817734fc8 (5b5ab0b0-8c09-4846-8148-703817734fc8): created successfully Dec 11 21:23:56.693336 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadf05e3-686d-4e6b-b7c0-54269b864309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:56.696459 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Flow 'volume_create_manager' (f86ff677-9bb1-4601-9abf-a3f56d917304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:56.704906 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-889cb914-17f9-4e25-b41a-a76d991caa5b tempest-VolumesListTestJSON-1032289019 None] Created volume successfully. Dec 11 21:23:57.983970 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:23:57.987394 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:23:57.988075 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:23:58.003354 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Flow 'volume_create_manager' (0da7c23e-7ab7-45d9-84ed-932909c84c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:58.006746 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4821f773-016d-413a-b974-af1bc5940d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:58.013635 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:23:58.026523 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4821f773-016d-413a-b974-af1bc5940d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-677409562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d848bd2d-5ba8-46ac-ae19-17ac452db5d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08af2b1ed42b4317a4ae83f340d5091f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:23:58Z,use_quota=True,user_id='36919347daf344d0890db26dd91171d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:58.029131 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada19f20-8aa3-4408-ac52-6c84d87b5f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:58.031398 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada19f20-8aa3-4408-ac52-6c84d87b5f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:58.033823 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f3ec1d-3a83-491b-947c-5fa219806806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:58.036171 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f3ec1d-3a83-491b-947c-5fa219806806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd848bd2d-5ba8-46ac-ae19-17ac452db5d6', 'volume_name': 'volume-d848bd2d-5ba8-46ac-ae19-17ac452db5d6', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:58.039033 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963d16d7-4c73-4f3d-a904-0598c6a7c264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:58.041142 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963d16d7-4c73-4f3d-a904-0598c6a7c264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:58.043384 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946717c7-0aa4-4313-b5b3-bd27e92981f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:58.044163 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Volume d848bd2d-5ba8-46ac-ae19-17ac452db5d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d848bd2d-5ba8-46ac-ae19-17ac452db5d6', 'volume_size': 1} Dec 11 21:23:58.044548 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] creating volume 'volume-d848bd2d-5ba8-46ac-ae19-17ac452db5d6' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:23:58.045501 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:58.114420 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:23:58.114944 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:23:58.118604 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946717c7-0aa4-4313-b5b3-bd27e92981f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d848bd2d-5ba8-46ac-ae19-17ac452db5d6', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:58.122379 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9e6aa4-6a89-440b-a5cd-58e6ba0cb7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:58.133438 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Volume volume-d848bd2d-5ba8-46ac-ae19-17ac452db5d6 (d848bd2d-5ba8-46ac-ae19-17ac452db5d6): created successfully Dec 11 21:23:58.135808 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9e6aa4-6a89-440b-a5cd-58e6ba0cb7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:58.138905 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Flow 'volume_create_manager' (0da7c23e-7ab7-45d9-84ed-932909c84c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:58.148125 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9378cbfc-16df-46d5-84ff-4b9ea8a56d15 tempest-VolumesListTestJSON-1032289019 None] Created volume successfully. Dec 11 21:23:59.620422 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:23:59.623689 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:23:59.628423 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:23:59.642773 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Flow 'volume_create_manager' (da4086a8-a9db-4d2a-aa49-4e255ec06f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:59.646104 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace5e686-bae8-4435-bdbe-7b24f13a3438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:59.653223 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:23:59.668360 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace5e686-bae8-4435-bdbe-7b24f13a3438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1658293861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fe54e817-43fa-4d2d-aee6-c3fc4b08e433,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08af2b1ed42b4317a4ae83f340d5091f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:24:00Z,use_quota=True,user_id='36919347daf344d0890db26dd91171d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:59.671021 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882e18c8-f759-413d-9297-2b57c59e516a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:59.673233 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882e18c8-f759-413d-9297-2b57c59e516a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:59.675714 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ebec5e-5497-4310-9ff9-451dc92be939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:59.679670 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ebec5e-5497-4310-9ff9-451dc92be939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe54e817-43fa-4d2d-aee6-c3fc4b08e433', 'volume_name': 'volume-fe54e817-43fa-4d2d-aee6-c3fc4b08e433', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:59.682123 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169e9e65-dcba-4bba-bded-dd2ff75d611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:59.684396 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169e9e65-dcba-4bba-bded-dd2ff75d611b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:59.686692 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edd43a0-ae47-4ce0-8124-175ea4447c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:59.687490 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Volume fe54e817-43fa-4d2d-aee6-c3fc4b08e433: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe54e817-43fa-4d2d-aee6-c3fc4b08e433', 'volume_size': 1} Dec 11 21:23:59.687889 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] creating volume 'volume-fe54e817-43fa-4d2d-aee6-c3fc4b08e433' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:23:59.689762 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:23:59.768372 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:23:59.770172 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:23:59.772724 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edd43a0-ae47-4ce0-8124-175ea4447c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe54e817-43fa-4d2d-aee6-c3fc4b08e433', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:59.775118 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e054aed7-8e60-471b-bc4d-4de89d0f442e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:23:59.789084 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Volume volume-fe54e817-43fa-4d2d-aee6-c3fc4b08e433 (fe54e817-43fa-4d2d-aee6-c3fc4b08e433): created successfully Dec 11 21:23:59.792063 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e054aed7-8e60-471b-bc4d-4de89d0f442e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:23:59.795295 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Flow 'volume_create_manager' (da4086a8-a9db-4d2a-aa49-4e255ec06f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:23:59.805251 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-288fe974-5dbc-4a68-8c96-285328dd35c6 tempest-VolumesListTestJSON-1032289019 None] Created volume successfully. Dec 11 21:24:03.612881 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-e8b47efd-d2ef-45cf-b594-81bd3c86c17f tempest-VolumesListTestJSON-1032289019 None] Lock "b'cinder-fe54e817-43fa-4d2d-aee6-c3fc4b08e433-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:24:03.651679 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e8b47efd-d2ef-45cf-b594-81bd3c86c17f tempest-VolumesListTestJSON-1032289019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:24:03.710152 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e8b47efd-d2ef-45cf-b594-81bd3c86c17f tempest-VolumesListTestJSON-1032289019 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:24:03.710622 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e8b47efd-d2ef-45cf-b594-81bd3c86c17f tempest-VolumesListTestJSON-1032289019 None] Volume volume-fe54e817-43fa-4d2d-aee6-c3fc4b08e433 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:24:03.718035 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e8b47efd-d2ef-45cf-b594-81bd3c86c17f tempest-VolumesListTestJSON-1032289019 None] deleting rbd volume volume-fe54e817-43fa-4d2d-aee6-c3fc4b08e433 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:24:04.005916 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-e8b47efd-d2ef-45cf-b594-81bd3c86c17f tempest-VolumesListTestJSON-1032289019 None] Created reservations ['e09a225f-4a8b-43a3-afd3-e2df212dfa18', '116a7e44-6ed0-4d4f-9cdd-ef72421c2630', '82e71f4d-9e46-424f-bbd6-dff7669a55d7', '6de04838-ac1a-4a46-a1ce-f6d69c5e3404'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:24:04.064679 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e8b47efd-d2ef-45cf-b594-81bd3c86c17f tempest-VolumesListTestJSON-1032289019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:24:04.097287 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-e8b47efd-d2ef-45cf-b594-81bd3c86c17f tempest-VolumesListTestJSON-1032289019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:24:04.132116 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-e8b47efd-d2ef-45cf-b594-81bd3c86c17f tempest-VolumesListTestJSON-1032289019 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:24:04.137292 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-e8b47efd-d2ef-45cf-b594-81bd3c86c17f tempest-VolumesListTestJSON-1032289019 None] Deleted volume successfully. Dec 11 21:24:04.161506 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-e8b47efd-d2ef-45cf-b594-81bd3c86c17f tempest-VolumesListTestJSON-1032289019 None] Lock "b'cinder-fe54e817-43fa-4d2d-aee6-c3fc4b08e433-delete_volume'" released by "delete_volume" :: held 0.547s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:24:04.759986 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7c09f58e-8110-4f8d-ba90-566e4131b3bc tempest-VolumesListTestJSON-1032289019 None] Lock "b'cinder-d848bd2d-5ba8-46ac-ae19-17ac452db5d6-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:24:04.804895 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7c09f58e-8110-4f8d-ba90-566e4131b3bc tempest-VolumesListTestJSON-1032289019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:24:04.859470 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7c09f58e-8110-4f8d-ba90-566e4131b3bc tempest-VolumesListTestJSON-1032289019 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:24:04.859909 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7c09f58e-8110-4f8d-ba90-566e4131b3bc tempest-VolumesListTestJSON-1032289019 None] Volume volume-d848bd2d-5ba8-46ac-ae19-17ac452db5d6 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:24:04.868680 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7c09f58e-8110-4f8d-ba90-566e4131b3bc tempest-VolumesListTestJSON-1032289019 None] deleting rbd volume volume-d848bd2d-5ba8-46ac-ae19-17ac452db5d6 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:24:05.184857 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-7c09f58e-8110-4f8d-ba90-566e4131b3bc tempest-VolumesListTestJSON-1032289019 None] Created reservations ['73cbeb6d-5b01-405d-87e1-9fa65d77ad35', '619535d9-8024-43f0-97c8-164d764335b2', 'd9475d05-eb69-4d05-8379-476eff208239', '63bc12f1-af10-47fd-99c5-8435a171aaa9'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:24:05.228431 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7c09f58e-8110-4f8d-ba90-566e4131b3bc tempest-VolumesListTestJSON-1032289019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:24:05.268887 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7c09f58e-8110-4f8d-ba90-566e4131b3bc tempest-VolumesListTestJSON-1032289019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:24:05.306428 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7c09f58e-8110-4f8d-ba90-566e4131b3bc tempest-VolumesListTestJSON-1032289019 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:24:05.310392 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-7c09f58e-8110-4f8d-ba90-566e4131b3bc tempest-VolumesListTestJSON-1032289019 None] Deleted volume successfully. Dec 11 21:24:05.323460 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-7c09f58e-8110-4f8d-ba90-566e4131b3bc tempest-VolumesListTestJSON-1032289019 None] Lock "b'cinder-d848bd2d-5ba8-46ac-ae19-17ac452db5d6-delete_volume'" released by "delete_volume" :: held 0.564s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:24:05.906545 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-f07c0abf-af3a-4e63-b8ab-5e8eb7900d58 tempest-VolumesListTestJSON-1032289019 None] Lock "b'cinder-5b5ab0b0-8c09-4846-8148-703817734fc8-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:24:05.943010 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f07c0abf-af3a-4e63-b8ab-5e8eb7900d58 tempest-VolumesListTestJSON-1032289019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:24:05.982590 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f07c0abf-af3a-4e63-b8ab-5e8eb7900d58 tempest-VolumesListTestJSON-1032289019 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:24:05.983150 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f07c0abf-af3a-4e63-b8ab-5e8eb7900d58 tempest-VolumesListTestJSON-1032289019 None] Volume volume-5b5ab0b0-8c09-4846-8148-703817734fc8 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:24:05.991796 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f07c0abf-af3a-4e63-b8ab-5e8eb7900d58 tempest-VolumesListTestJSON-1032289019 None] deleting rbd volume volume-5b5ab0b0-8c09-4846-8148-703817734fc8 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:24:06.266633 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-f07c0abf-af3a-4e63-b8ab-5e8eb7900d58 tempest-VolumesListTestJSON-1032289019 None] Created reservations ['313da662-10f1-484f-9d73-0c38ca1543db', '7a270619-798f-471a-b45a-de5c0ea9456f', '01d39327-aefb-4a85-bcc0-c01ece09ff08', 'b1532fa3-ab16-487a-9b76-ff59b4b459d0'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:24:06.322379 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f07c0abf-af3a-4e63-b8ab-5e8eb7900d58 tempest-VolumesListTestJSON-1032289019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:24:06.350340 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-f07c0abf-af3a-4e63-b8ab-5e8eb7900d58 tempest-VolumesListTestJSON-1032289019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:24:06.377465 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-f07c0abf-af3a-4e63-b8ab-5e8eb7900d58 tempest-VolumesListTestJSON-1032289019 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:24:06.381388 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-f07c0abf-af3a-4e63-b8ab-5e8eb7900d58 tempest-VolumesListTestJSON-1032289019 None] Deleted volume successfully. Dec 11 21:24:06.392781 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-f07c0abf-af3a-4e63-b8ab-5e8eb7900d58 tempest-VolumesListTestJSON-1032289019 None] Lock "b'cinder-5b5ab0b0-8c09-4846-8148-703817734fc8-delete_volume'" released by "delete_volume" :: held 0.487s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:24:55.865868 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:24:55.866581 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:24:55.893476 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:24:55.935079 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:25:36.770330 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-17566c50-0dfb-42cc-9deb-bd197e859d8c tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:25:37.867112 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-17566c50-0dfb-42cc-9deb-bd197e859d8c tempest-TestVolumeBootPattern-909971433 None] Create snapshot completed successfully Dec 11 21:25:39.161938 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:25:39.165157 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:25:39.165599 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:25:39.188424 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Flow 'volume_create_manager' (b0c54fb4-d967-4ecc-bea0-189e3a75d65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:25:39.191694 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0442c8f5-640c-4953-a2a7-b0491562b482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:25:39.198267 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:25:39.210390 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0442c8f5-640c-4953-a2a7-b0491562b482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1023637047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1252039d-ae8f-4317-9f1a-cad1b12ecd54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f0381bbbd84752abdbd2d9ae843b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d55a2bfd-57a0-4b9a-8f4f-7365cf7c4d7a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:25:39Z,use_quota=True,user_id='8b579ede23eb483b89f94f8e1696a638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:25:39.213662 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a676600-7f2b-4ff5-8035-3180ec39ed9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:25:39.215859 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a676600-7f2b-4ff5-8035-3180ec39ed9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:25:39.218281 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e59b0b4-404d-44f6-871e-7efd75cd67c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:25:39.220840 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e59b0b4-404d-44f6-871e-7efd75cd67c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1252039d-ae8f-4317-9f1a-cad1b12ecd54', 'volume_name': 'volume-1252039d-ae8f-4317-9f1a-cad1b12ecd54', 'volume_size': 1, 'snapshot_id': 'd55a2bfd-57a0-4b9a-8f4f-7365cf7c4d7a'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:25:39.223188 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da0daa6-4377-49d4-b83a-a66638d58b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:25:39.225320 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da0daa6-4377-49d4-b83a-a66638d58b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:25:39.227666 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137a4585-53ef-4302-97f6-86435b18b29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:25:39.228427 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Volume 1252039d-ae8f-4317-9f1a-cad1b12ecd54: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1252039d-ae8f-4317-9f1a-cad1b12ecd54', 'volume_size': 1, 'snapshot_id': 'd55a2bfd-57a0-4b9a-8f4f-7365cf7c4d7a'} Dec 11 21:25:39.248410 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] cloning volumes/volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27@snapshot-d55a2bfd-57a0-4b9a-8f4f-7365cf7c4d7a to volume-1252039d-ae8f-4317-9f1a-cad1b12ecd54 {{(pid=134173) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 11 21:25:39.249292 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:25:39.308037 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:25:39.431711 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:25:39.431992 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:25:39.451048 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Marking volume 1252039d-ae8f-4317-9f1a-cad1b12ecd54 as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:25:39.455700 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Copying metadata from snapshot d55a2bfd-57a0-4b9a-8f4f-7365cf7c4d7a to 1252039d-ae8f-4317-9f1a-cad1b12ecd54. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Dec 11 21:25:39.484284 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137a4585-53ef-4302-97f6-86435b18b29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1252039d-ae8f-4317-9f1a-cad1b12ecd54', 'volume_size': 1, 'snapshot_id': 'd55a2bfd-57a0-4b9a-8f4f-7365cf7c4d7a'}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:25:39.486567 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e49caf-53a9-402e-aff3-73a063056eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:25:39.494010 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Volume volume-1252039d-ae8f-4317-9f1a-cad1b12ecd54 (1252039d-ae8f-4317-9f1a-cad1b12ecd54): created successfully Dec 11 21:25:39.495871 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e49caf-53a9-402e-aff3-73a063056eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:25:39.498870 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Flow 'volume_create_manager' (b0c54fb4-d967-4ecc-bea0-189e3a75d65d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:25:39.510800 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-8c6d7228-6fba-4ca7-901b-237b5d2b08ec tempest-TestVolumeBootPattern-909971433 None] Created volume successfully. Dec 11 21:25:42.013373 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-7f4274ca-1dc8-45fc-92eb-7000838a2fcd req-b2486424-8a62-4f80-96d0-d3e4def5c866 tempest-TestVolumeBootPattern-909971433 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:25:42.698169 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-7f4274ca-1dc8-45fc-92eb-7000838a2fcd req-b2486424-8a62-4f80-96d0-d3e4def5c866 tempest-TestVolumeBootPattern-909971433 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.684s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:25:42.699004 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-7f4274ca-1dc8-45fc-92eb-7000838a2fcd req-b2486424-8a62-4f80-96d0-d3e4def5c866 tempest-TestVolumeBootPattern-909971433 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1252039d-ae8f-4317-9f1a-cad1b12ecd54', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '1252039d-ae8f-4317-9f1a-cad1b12ecd54', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:25:42.722060 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-7f4274ca-1dc8-45fc-92eb-7000838a2fcd req-b2486424-8a62-4f80-96d0-d3e4def5c866 tempest-TestVolumeBootPattern-909971433 None] Connection info returned from driver {'name': 'volumes/volume-1252039d-ae8f-4317-9f1a-cad1b12ecd54', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1252039d-ae8f-4317-9f1a-cad1b12ecd54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c52d8a17-f434-4b15-967a-104baa01aeff'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:25:42.769964 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-7f4274ca-1dc8-45fc-92eb-7000838a2fcd req-b2486424-8a62-4f80-96d0-d3e4def5c866 tempest-TestVolumeBootPattern-909971433 None] attachment_update completed successfully. Dec 11 21:25:55.868439 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:25:55.869509 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:25:55.893758 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:25:55.916111 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:26:55.873588 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:26:55.874316 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:26:55.895779 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:26:55.917392 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:27:31.480862 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-b1ee2a68-7e0d-4995-ab0b-51af1be0ca2f req-3b01647b-b936-4b1b-a7d7-499f6346a5d7 tempest-TestVolumeBootPattern-909971433 None] Terminate volume connection completed successfully. Dec 11 21:27:31.481516 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-b1ee2a68-7e0d-4995-ab0b-51af1be0ca2f req-3b01647b-b936-4b1b-a7d7-499f6346a5d7 tempest-TestVolumeBootPattern-909971433 None] Deleting attachment c52d8a17-f434-4b15-967a-104baa01aeff. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:27:32.992205 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-9e9e5271-b953-444e-b0d7-1b05ea7b502f tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-1252039d-ae8f-4317-9f1a-cad1b12ecd54-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:27:33.023946 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9e9e5271-b953-444e-b0d7-1b05ea7b502f tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:27:33.097081 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9e9e5271-b953-444e-b0d7-1b05ea7b502f tempest-TestVolumeBootPattern-909971433 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:27:33.104537 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9e9e5271-b953-444e-b0d7-1b05ea7b502f tempest-TestVolumeBootPattern-909971433 None] deleting rbd volume volume-1252039d-ae8f-4317-9f1a-cad1b12ecd54 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:27:33.337236 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-9e9e5271-b953-444e-b0d7-1b05ea7b502f tempest-TestVolumeBootPattern-909971433 None] Created reservations ['0836e02c-64eb-4b2f-8f44-2dc77cc87aca', 'e8093cc2-8976-4c2a-85cc-c312b36f4576', 'f015c749-641a-4923-970b-a4eacd62a126', '5c4c9018-8751-4b41-8408-bb47a6a9a9cf'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:27:33.377502 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9e9e5271-b953-444e-b0d7-1b05ea7b502f tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:27:33.399590 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-9e9e5271-b953-444e-b0d7-1b05ea7b502f tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:27:33.422361 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-9e9e5271-b953-444e-b0d7-1b05ea7b502f tempest-TestVolumeBootPattern-909971433 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:27:33.426614 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-9e9e5271-b953-444e-b0d7-1b05ea7b502f tempest-TestVolumeBootPattern-909971433 None] Deleted volume successfully. Dec 11 21:27:33.438684 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-9e9e5271-b953-444e-b0d7-1b05ea7b502f tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-1252039d-ae8f-4317-9f1a-cad1b12ecd54-delete_volume'" released by "delete_volume" :: held 0.447s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:27:34.111868 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d4e3eee7-5934-496e-ad79-ebfe7533a777 tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-d55a2bfd-57a0-4b9a-8f4f-7365cf7c4d7a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:27:34.113413 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-d4e3eee7-5934-496e-ad79-ebfe7533a777 tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:27:55.872424 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:27:55.873106 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:27:55.893798 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:27:55.915049 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:28:04.263258 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-d4e3eee7-5934-496e-ad79-ebfe7533a777 tempest-TestVolumeBootPattern-909971433 None] Created reservations ['ee135dd6-94e9-43b4-9b82-18692ecf4405', '1f25ffac-446a-42a5-80ea-f92c946994f2', '062dbc18-c561-4fc4-ae09-c4fc5f881c5c', 'bb7b2f4b-ca0f-478f-96d3-459fa5566148'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:28:04.300308 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-d4e3eee7-5934-496e-ad79-ebfe7533a777 tempest-TestVolumeBootPattern-909971433 None] Delete snapshot completed successfully. Dec 11 21:28:04.304916 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-d4e3eee7-5934-496e-ad79-ebfe7533a777 tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-d55a2bfd-57a0-4b9a-8f4f-7365cf7c4d7a-delete_snapshot'" released by "delete_snapshot" :: held 30.193s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:28:08.344156 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-25dbb6ee-3e02-46ab-96c8-6561a6a4e3f9 req-25d30597-4fe9-458c-a7a2-55c8dcce6b69 tempest-TestVolumeBootPattern-909971433 None] Terminate volume connection completed successfully. Dec 11 21:28:08.344763 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-25dbb6ee-3e02-46ab-96c8-6561a6a4e3f9 req-25d30597-4fe9-458c-a7a2-55c8dcce6b69 tempest-TestVolumeBootPattern-909971433 None] Deleting attachment 0c341d4d-f169-4099-9356-e7f6c3dfe909. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:28:09.411131 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-1eb56739-89cf-42d5-820f-5f03cfc21ffc tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-2f8227b8-bd5e-456e-866f-fd0bf6c93d27-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:28:09.441148 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1eb56739-89cf-42d5-820f-5f03cfc21ffc tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:28:09.506909 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1eb56739-89cf-42d5-820f-5f03cfc21ffc tempest-TestVolumeBootPattern-909971433 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:28:09.514625 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1eb56739-89cf-42d5-820f-5f03cfc21ffc tempest-TestVolumeBootPattern-909971433 None] deleting rbd volume volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:28:09.731649 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1eb56739-89cf-42d5-820f-5f03cfc21ffc tempest-TestVolumeBootPattern-909971433 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 21:28:09.764698 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1eb56739-89cf-42d5-820f-5f03cfc21ffc tempest-TestVolumeBootPattern-909971433 None] deleting parent snapshot volume-2f8227b8-bd5e-456e-866f-fd0bf6c93d27.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 21:28:10.710313 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-1eb56739-89cf-42d5-820f-5f03cfc21ffc tempest-TestVolumeBootPattern-909971433 None] Created reservations ['20eefecf-7465-49ba-8ae5-cab210f9b008', 'd7ddcaa5-8e96-4461-8fd1-5ae3ae18ca48', '52c5de0e-665c-402d-9900-e43b393d73d0', '0cc3de9e-ce39-4cfa-ac8a-debc1d3f2ac5'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:28:10.750219 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1eb56739-89cf-42d5-820f-5f03cfc21ffc tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:28:10.773672 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-1eb56739-89cf-42d5-820f-5f03cfc21ffc tempest-TestVolumeBootPattern-909971433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:28:10.796048 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-1eb56739-89cf-42d5-820f-5f03cfc21ffc tempest-TestVolumeBootPattern-909971433 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:28:10.801657 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-1eb56739-89cf-42d5-820f-5f03cfc21ffc tempest-TestVolumeBootPattern-909971433 None] Deleted volume successfully. Dec 11 21:28:10.812886 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-1eb56739-89cf-42d5-820f-5f03cfc21ffc tempest-TestVolumeBootPattern-909971433 None] Lock "b'cinder-2f8227b8-bd5e-456e-866f-fd0bf6c93d27-delete_volume'" released by "delete_volume" :: held 1.402s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:28:55.871106 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:28:55.871839 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:28:55.909326 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:28:55.935769 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:29:55.873139 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:29:55.874188 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:29:55.895177 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:29:55.917370 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:30:55.873403 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:30:55.874105 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:30:55.894868 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:30:55.916902 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:32:55.874019 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:32:55.874749 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:32:55.896131 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:32:55.918007 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:33:55.873534 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:33:55.874222 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:33:55.905215 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:33:55.936356 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:34:55.872169 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:34:55.872891 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:34:55.893590 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:34:55.915634 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:35:55.870559 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:35:55.872575 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:35:55.891821 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:35:55.914319 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:36:55.870031 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:36:55.870716 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:36:55.891188 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:36:55.912809 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:37:55.868001 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:37:55.868705 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:37:55.890972 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:37:55.912002 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:38:55.868076 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:38:55.868807 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:38:55.890972 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:38:55.912222 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:39:55.867942 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:39:55.869111 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:39:55.890310 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:39:55.912287 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:40:36.113043 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:40:36.116722 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:40:36.117205 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:40:36.129796 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Flow 'volume_create_manager' (1432548e-020b-48f3-aae6-fdddb20a7ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:40:36.133105 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84bd9d4a-2595-43aa-ba41-7526c8d60147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:40:36.139205 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:40:36.151173 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84bd9d4a-2595-43aa-ba41-7526c8d60147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1298888336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=59dd43dd-716b-4188-98f7-66c9270749d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a438de10749f45bb942385fb5c6fb084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:40:36Z,use_quota=True,user_id='f72ff334f7404024a91591711bf13fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:40:36.153783 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699d1294-80ae-447d-8c87-b0937eafe287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:40:36.156504 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699d1294-80ae-447d-8c87-b0937eafe287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:40:36.158986 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d24213-123e-420b-8239-f26e26c410b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:40:36.161263 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d24213-123e-420b-8239-f26e26c410b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59dd43dd-716b-4188-98f7-66c9270749d7', 'volume_name': 'volume-59dd43dd-716b-4188-98f7-66c9270749d7', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:40:36.163658 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebc0429-d5aa-463d-b0e3-fd5a1ef71f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:40:36.165816 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebc0429-d5aa-463d-b0e3-fd5a1ef71f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:40:36.168099 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c07904d-d392-495e-805e-4d7e59be5dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:40:36.168887 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Volume 59dd43dd-716b-4188-98f7-66c9270749d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59dd43dd-716b-4188-98f7-66c9270749d7', 'volume_size': 1} Dec 11 21:40:36.169284 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] creating volume 'volume-59dd43dd-716b-4188-98f7-66c9270749d7' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:40:36.170243 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:40:36.220580 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:40:36.221040 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:40:36.223211 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c07904d-d392-495e-805e-4d7e59be5dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59dd43dd-716b-4188-98f7-66c9270749d7', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:40:36.225418 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c05e3e-02b4-449c-a367-5b6252e99fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:40:36.234768 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Volume volume-59dd43dd-716b-4188-98f7-66c9270749d7 (59dd43dd-716b-4188-98f7-66c9270749d7): created successfully Dec 11 21:40:36.236867 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c05e3e-02b4-449c-a367-5b6252e99fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:40:36.239866 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Flow 'volume_create_manager' (1432548e-020b-48f3-aae6-fdddb20a7ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:40:36.246979 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-5d33eac8-27b1-4654-bbc2-5a03d9146a47 tempest-ServerActionsTestJSON-1513721892 None] Created volume successfully. Dec 11 21:40:37.678324 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-c0c9b7ed-04f1-4c68-ae45-0f09759b3413 req-e8e4556e-5f66-4f8b-ac21-47a38f3b9689 tempest-ServerActionsTestJSON-1513721892 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:40:38.320938 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-c0c9b7ed-04f1-4c68-ae45-0f09759b3413 req-e8e4556e-5f66-4f8b-ac21-47a38f3b9689 tempest-ServerActionsTestJSON-1513721892 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.642s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:40:38.321754 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-c0c9b7ed-04f1-4c68-ae45-0f09759b3413 req-e8e4556e-5f66-4f8b-ac21-47a38f3b9689 tempest-ServerActionsTestJSON-1513721892 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-59dd43dd-716b-4188-98f7-66c9270749d7', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '59dd43dd-716b-4188-98f7-66c9270749d7', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:40:38.344475 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-c0c9b7ed-04f1-4c68-ae45-0f09759b3413 req-e8e4556e-5f66-4f8b-ac21-47a38f3b9689 tempest-ServerActionsTestJSON-1513721892 None] Connection info returned from driver {'name': 'volumes/volume-59dd43dd-716b-4188-98f7-66c9270749d7', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '59dd43dd-716b-4188-98f7-66c9270749d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'faa50e1f-299b-479e-8f8b-5167c183a298'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:40:38.392251 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-c0c9b7ed-04f1-4c68-ae45-0f09759b3413 req-e8e4556e-5f66-4f8b-ac21-47a38f3b9689 tempest-ServerActionsTestJSON-1513721892 None] attachment_update completed successfully. Dec 11 21:40:55.868434 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:40:55.870055 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:40:55.909262 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:40:55.939489 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:40:58.157679 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-12f3b170-2caa-48b0-a60f-f4584f32fe9d req-c1962bde-89a3-473e-b7ff-9b5a21d4193b tempest-ServerActionsTestJSON-1513721892 None] Terminate volume connection completed successfully. Dec 11 21:40:58.158321 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-12f3b170-2caa-48b0-a60f-f4584f32fe9d req-c1962bde-89a3-473e-b7ff-9b5a21d4193b tempest-ServerActionsTestJSON-1513721892 None] Deleting attachment faa50e1f-299b-479e-8f8b-5167c183a298. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:40:59.981110 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-12f3b170-2caa-48b0-a60f-f4584f32fe9d req-ef214328-ed0a-4ec3-b010-9c2298b71697 tempest-ServerActionsTestJSON-1513721892 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:41:00.628156 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-12f3b170-2caa-48b0-a60f-f4584f32fe9d req-ef214328-ed0a-4ec3-b010-9c2298b71697 tempest-ServerActionsTestJSON-1513721892 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.647s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:41:00.628853 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-12f3b170-2caa-48b0-a60f-f4584f32fe9d req-ef214328-ed0a-4ec3-b010-9c2298b71697 tempest-ServerActionsTestJSON-1513721892 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-59dd43dd-716b-4188-98f7-66c9270749d7', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '59dd43dd-716b-4188-98f7-66c9270749d7', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:41:00.651485 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-12f3b170-2caa-48b0-a60f-f4584f32fe9d req-ef214328-ed0a-4ec3-b010-9c2298b71697 tempest-ServerActionsTestJSON-1513721892 None] Connection info returned from driver {'name': 'volumes/volume-59dd43dd-716b-4188-98f7-66c9270749d7', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '59dd43dd-716b-4188-98f7-66c9270749d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '71cd9a7e-fa09-4b83-9812-ca1dda9afa3c'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:41:00.696349 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-12f3b170-2caa-48b0-a60f-f4584f32fe9d req-ef214328-ed0a-4ec3-b010-9c2298b71697 tempest-ServerActionsTestJSON-1513721892 None] attachment_update completed successfully. Dec 11 21:41:09.038898 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-614d5bc0-d370-4ae9-a6b5-5691aff3d2ce req-afffc963-b727-433f-a779-2ec139bb3e34 tempest-ServerActionsTestJSON-1513721892 None] Terminate volume connection completed successfully. Dec 11 21:41:09.039738 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-614d5bc0-d370-4ae9-a6b5-5691aff3d2ce req-afffc963-b727-433f-a779-2ec139bb3e34 tempest-ServerActionsTestJSON-1513721892 None] Deleting attachment 71cd9a7e-fa09-4b83-9812-ca1dda9afa3c. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:41:11.576536 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-614d5bc0-d370-4ae9-a6b5-5691aff3d2ce req-58927fa5-b96d-4a07-9aed-5a5aca8d5c31 tempest-ServerActionsTestJSON-1513721892 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:41:12.214947 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-614d5bc0-d370-4ae9-a6b5-5691aff3d2ce req-58927fa5-b96d-4a07-9aed-5a5aca8d5c31 tempest-ServerActionsTestJSON-1513721892 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.638s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:41:12.215721 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-614d5bc0-d370-4ae9-a6b5-5691aff3d2ce req-58927fa5-b96d-4a07-9aed-5a5aca8d5c31 tempest-ServerActionsTestJSON-1513721892 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-59dd43dd-716b-4188-98f7-66c9270749d7', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '59dd43dd-716b-4188-98f7-66c9270749d7', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:41:12.237535 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-614d5bc0-d370-4ae9-a6b5-5691aff3d2ce req-58927fa5-b96d-4a07-9aed-5a5aca8d5c31 tempest-ServerActionsTestJSON-1513721892 None] Connection info returned from driver {'name': 'volumes/volume-59dd43dd-716b-4188-98f7-66c9270749d7', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '59dd43dd-716b-4188-98f7-66c9270749d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e39a8084-40f6-48db-95b4-ca563d6b0a3d'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:41:12.286573 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-614d5bc0-d370-4ae9-a6b5-5691aff3d2ce req-58927fa5-b96d-4a07-9aed-5a5aca8d5c31 tempest-ServerActionsTestJSON-1513721892 None] attachment_update completed successfully. Dec 11 21:41:19.175626 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-28321115-445e-4762-aec3-15eb8715c254 req-68e76899-9d60-4a3e-b548-a0aa6458ce0d tempest-ServerActionsTestJSON-1513721892 None] Terminate volume connection completed successfully. Dec 11 21:41:19.176217 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-28321115-445e-4762-aec3-15eb8715c254 req-68e76899-9d60-4a3e-b548-a0aa6458ce0d tempest-ServerActionsTestJSON-1513721892 None] Deleting attachment e39a8084-40f6-48db-95b4-ca563d6b0a3d. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:41:20.351172 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-3ef1fbaa-d433-448e-8e72-42b09c50cc55 tempest-ServerActionsTestJSON-1513721892 None] Lock "b'cinder-59dd43dd-716b-4188-98f7-66c9270749d7-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:41:20.386676 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3ef1fbaa-d433-448e-8e72-42b09c50cc55 tempest-ServerActionsTestJSON-1513721892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:41:20.428829 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3ef1fbaa-d433-448e-8e72-42b09c50cc55 tempest-ServerActionsTestJSON-1513721892 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:41:20.429395 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3ef1fbaa-d433-448e-8e72-42b09c50cc55 tempest-ServerActionsTestJSON-1513721892 None] Volume volume-59dd43dd-716b-4188-98f7-66c9270749d7 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:41:20.434030 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3ef1fbaa-d433-448e-8e72-42b09c50cc55 tempest-ServerActionsTestJSON-1513721892 None] deleting rbd volume volume-59dd43dd-716b-4188-98f7-66c9270749d7 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:41:20.628203 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-3ef1fbaa-d433-448e-8e72-42b09c50cc55 tempest-ServerActionsTestJSON-1513721892 None] Created reservations ['3eaf16f3-f432-4aea-8a32-121d1b553656', '0daa8bfb-94b8-4a4d-b217-a154a55d796a', '233eb26e-2939-4f0a-9196-b26b5a95a8eb', '8f40ec50-45bf-4ef3-9993-33f0dc0449bc'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:41:20.665613 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3ef1fbaa-d433-448e-8e72-42b09c50cc55 tempest-ServerActionsTestJSON-1513721892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:41:20.687475 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3ef1fbaa-d433-448e-8e72-42b09c50cc55 tempest-ServerActionsTestJSON-1513721892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:41:20.710769 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-3ef1fbaa-d433-448e-8e72-42b09c50cc55 tempest-ServerActionsTestJSON-1513721892 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:41:20.714988 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-3ef1fbaa-d433-448e-8e72-42b09c50cc55 tempest-ServerActionsTestJSON-1513721892 None] Deleted volume successfully. Dec 11 21:41:20.726884 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-3ef1fbaa-d433-448e-8e72-42b09c50cc55 tempest-ServerActionsTestJSON-1513721892 None] Lock "b'cinder-59dd43dd-716b-4188-98f7-66c9270749d7-delete_volume'" released by "delete_volume" :: held 0.376s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:41:55.864648 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:41:55.865313 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:41:55.891107 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:41:55.915717 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:42:54.522718 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:42:54.526403 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:42:54.526924 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:42:54.541877 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Flow 'volume_create_manager' (9dbfd226-a1a6-42af-a399-2a46585a3b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:42:54.545215 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b803497-458c-4c1e-bfa2-a2a077e54b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:42:54.551715 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:42:54.564610 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b803497-458c-4c1e-bfa2-a2a077e54b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-941825890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4429c18d-e3f1-4a2a-87f2-aa5f120398c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c76909bd27341bfab0a002ce16185c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:42:54Z,use_quota=True,user_id='0af4eceee0cc44fb8117a822dde1a6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:42:54.567261 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b858ca-2e7f-4982-80db-1818f72b4f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:42:54.569459 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b858ca-2e7f-4982-80db-1818f72b4f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:42:54.571939 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0f6f0f-417a-402d-a5ca-90c20f66834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:42:54.574221 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0f6f0f-417a-402d-a5ca-90c20f66834b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4429c18d-e3f1-4a2a-87f2-aa5f120398c7', 'volume_name': 'volume-4429c18d-e3f1-4a2a-87f2-aa5f120398c7', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:42:54.576667 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7574327-70b5-430a-9c33-7d3eeb12375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:42:54.578828 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7574327-70b5-430a-9c33-7d3eeb12375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:42:54.581064 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ad80a7-8e85-4cb5-80e5-095e481b781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:42:54.581845 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Volume 4429c18d-e3f1-4a2a-87f2-aa5f120398c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4429c18d-e3f1-4a2a-87f2-aa5f120398c7', 'volume_size': 1} Dec 11 21:42:54.582242 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] creating volume 'volume-4429c18d-e3f1-4a2a-87f2-aa5f120398c7' {{(pid=134173) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 11 21:42:54.583247 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:42:54.634325 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:42:54.634723 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:42:54.636739 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ad80a7-8e85-4cb5-80e5-095e481b781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4429c18d-e3f1-4a2a-87f2-aa5f120398c7', 'volume_size': 1}' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:42:54.638959 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034c5cb9-87f8-4f41-9a15-e4ca24f1b4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:42:54.647821 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Volume volume-4429c18d-e3f1-4a2a-87f2-aa5f120398c7 (4429c18d-e3f1-4a2a-87f2-aa5f120398c7): created successfully Dec 11 21:42:54.649748 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034c5cb9-87f8-4f41-9a15-e4ca24f1b4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:42:54.652853 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Flow 'volume_create_manager' (9dbfd226-a1a6-42af-a399-2a46585a3b8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:42:54.659939 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-248d24bb-74a5-4abb-8dc8-888d924dde81 tempest-TestMinimumBasicScenario-1618858629 None] Created volume successfully. Dec 11 21:42:55.860819 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:42:55.861814 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:42:55.892583 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:42:55.925743 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:42:56.067066 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-e64c653c-8f65-424e-b575-3cab3d31d6b0 req-6a54eee8-0b10-47cb-9a85-b18225ef0195 tempest-TestMinimumBasicScenario-1618858629 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:42:56.761520 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-e64c653c-8f65-424e-b575-3cab3d31d6b0 req-6a54eee8-0b10-47cb-9a85-b18225ef0195 tempest-TestMinimumBasicScenario-1618858629 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.694s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:42:56.762401 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-e64c653c-8f65-424e-b575-3cab3d31d6b0 req-6a54eee8-0b10-47cb-9a85-b18225ef0195 tempest-TestMinimumBasicScenario-1618858629 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4429c18d-e3f1-4a2a-87f2-aa5f120398c7', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': '4429c18d-e3f1-4a2a-87f2-aa5f120398c7', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:42:56.786217 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-e64c653c-8f65-424e-b575-3cab3d31d6b0 req-6a54eee8-0b10-47cb-9a85-b18225ef0195 tempest-TestMinimumBasicScenario-1618858629 None] Connection info returned from driver {'name': 'volumes/volume-4429c18d-e3f1-4a2a-87f2-aa5f120398c7', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4429c18d-e3f1-4a2a-87f2-aa5f120398c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '12064e35-2783-43de-8cf6-aa14f2f79251'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:42:56.829986 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-e64c653c-8f65-424e-b575-3cab3d31d6b0 req-6a54eee8-0b10-47cb-9a85-b18225ef0195 tempest-TestMinimumBasicScenario-1618858629 None] attachment_update completed successfully. Dec 11 21:43:55.864412 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:43:55.865289 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:43:55.888383 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:43:55.910293 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:44:14.485353 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-152942cc-0e67-4990-9f5f-5e99e3a7a3fd req-791e98f5-d896-45ff-b8e3-74b6ae4a20bf tempest-TestMinimumBasicScenario-1618858629 None] Terminate volume connection completed successfully. Dec 11 21:44:14.486009 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-152942cc-0e67-4990-9f5f-5e99e3a7a3fd req-791e98f5-d896-45ff-b8e3-74b6ae4a20bf tempest-TestMinimumBasicScenario-1618858629 None] Deleting attachment 12064e35-2783-43de-8cf6-aa14f2f79251. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:44:15.148741 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-3997934a-8cf5-48a2-8ac5-9c66f9ca3465 tempest-TestMinimumBasicScenario-1618858629 None] Lock "b'cinder-4429c18d-e3f1-4a2a-87f2-aa5f120398c7-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:44:15.185191 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3997934a-8cf5-48a2-8ac5-9c66f9ca3465 tempest-TestMinimumBasicScenario-1618858629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:44:15.233590 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3997934a-8cf5-48a2-8ac5-9c66f9ca3465 tempest-TestMinimumBasicScenario-1618858629 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 21:44:15.233955 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3997934a-8cf5-48a2-8ac5-9c66f9ca3465 tempest-TestMinimumBasicScenario-1618858629 None] Volume volume-4429c18d-e3f1-4a2a-87f2-aa5f120398c7 is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:44:15.240106 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3997934a-8cf5-48a2-8ac5-9c66f9ca3465 tempest-TestMinimumBasicScenario-1618858629 None] deleting rbd volume volume-4429c18d-e3f1-4a2a-87f2-aa5f120398c7 {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 21:44:15.444320 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [None req-3997934a-8cf5-48a2-8ac5-9c66f9ca3465 tempest-TestMinimumBasicScenario-1618858629 None] Created reservations ['b4f44494-e67f-4817-9769-4a41aa9c59ac', 'be99e8d9-949f-4521-a8e2-4df7f9f58936', '4ed1195a-7b22-42c7-a5ed-6939fbc4e22b', '1bc1f607-f116-4585-8e77-1177382211a0'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 21:44:15.483844 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3997934a-8cf5-48a2-8ac5-9c66f9ca3465 tempest-TestMinimumBasicScenario-1618858629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:44:15.506061 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-3997934a-8cf5-48a2-8ac5-9c66f9ca3465 tempest-TestMinimumBasicScenario-1618858629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:44:15.534987 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-3997934a-8cf5-48a2-8ac5-9c66f9ca3465 tempest-TestMinimumBasicScenario-1618858629 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:44:15.540724 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-3997934a-8cf5-48a2-8ac5-9c66f9ca3465 tempest-TestMinimumBasicScenario-1618858629 None] Deleted volume successfully. Dec 11 21:44:15.556867 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-3997934a-8cf5-48a2-8ac5-9c66f9ca3465 tempest-TestMinimumBasicScenario-1618858629 None] Lock "b'cinder-4429c18d-e3f1-4a2a-87f2-aa5f120398c7-delete_volume'" released by "delete_volume" :: held 0.408s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:44:55.866132 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:44:55.866822 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:44:55.887964 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:44:55.909572 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:45:55.866039 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:45:55.866748 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:45:55.888349 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:45:55.910385 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:46:55.870004 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:46:55.870733 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:46:55.892333 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:46:55.913986 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:47:55.869925 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:47:55.870610 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:47:55.897320 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:47:55.925293 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:48:55.870701 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:48:55.871414 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:48:55.893732 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:48:55.915770 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:49:55.871133 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:49:55.871841 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:49:55.893207 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:49:55.915866 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:50:55.871297 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:50:55.872039 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:50:55.894215 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:50:55.915393 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:51:55.871000 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:51:55.871726 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:51:55.892398 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:51:55.914066 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:52:55.869914 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:52:55.870665 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:52:55.891170 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:52:55.913164 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:53:55.868590 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:53:55.869314 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:53:55.889623 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:53:55.911158 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:54:55.866393 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:54:55.867147 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:54:55.902814 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:54:55.933037 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:55:55.869521 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:55:55.870221 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:55:55.891350 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:55:55.920870 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:56:31.370912 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134173) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 11 21:56:31.374543 ncdv-master-1 cinder-volume[134173]: WARNING stevedore.named [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 11 21:56:31.375026 ncdv-master-1 cinder-volume[134173]: WARNING castellan.key_manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 11 21:56:31.387855 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Flow 'volume_create_manager' (25f29a0f-5210-4666-94a6-18b0b1053775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:56:31.391770 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6271445-e8a9-4060-a56b-58b4aa13b9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:56:31.399391 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_db.sqlalchemy.engines [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 11 21:56:31.412186 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6271445-e8a9-4060-a56b-58b4aa13b9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-11T21:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1980841259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d09a9fe3-9a30-44e0-9d8f-f30bf776750a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b98a2ac1da54946bf45bf34c7530a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-11T21:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-11T21:56:31Z,use_quota=True,user_id='c417d539bb4c47369c8d5ba3e7bdd362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aaae771-290d-40aa-8e6c-3fda92dceecd),volume_type_id=5aaae771-290d-40aa-8e6c-3fda92dceecd)' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:56:31.414827 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b56a47-0f1e-4367-8577-7e48bcbfa615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:56:31.417052 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b56a47-0f1e-4367-8577-7e48bcbfa615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:56:31.419564 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985af263-f7b8-4822-b91f-8320f686c4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:56:31.497865 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985af263-f7b8-4822-b91f-8320f686c4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd09a9fe3-9a30-44e0-9d8f-f30bf776750a', 'volume_name': 'volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:56:31.500334 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e168b918-84fd-4ac7-a652-d09381ca043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:56:31.503117 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e168b918-84fd-4ac7-a652-d09381ca043d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:56:31.505459 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2e0ffe-59ff-4d5f-a072-ec1bce3cb9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:56:31.506282 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Volume d09a9fe3-9a30-44e0-9d8f-f30bf776750a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 11 21:56:31.506875 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Cloning d09a9fe3-9a30-44e0-9d8f-f30bf776750a from image 659d8dfa-8ba1-483c-93c0-647553900999 at location (None, None). {{(pid=134173) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 11 21:56:31.515109 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 21:56:31.524427 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 56, 31, 519636)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:56:31.524859 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:56:31.525255 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Found cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 11 21:56:31.529426 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Lock "b'cinder-659d8dfa-8ba1-483c-93c0-647553900999'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 21:56:31.530288 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Attempting to retrieve cache entry for image = 659d8dfa-8ba1-483c-93c0-647553900999 on host ncdv-master-1@ceph#ceph. {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 11 21:56:31.535700 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Found image-volume cache entry: {'id': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'volume_id': '77b5072a-b5ee-4761-8a94-97ee1dfb3e78', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30), 'last_used': datetime.datetime(2021, 12, 11, 21, 56, 31, 533607)}. {{(pid=134173) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 11 21:56:31.536107 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.image.cache [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Image-volume cache entry image_update_at = 2021-12-11 20:39:30+00:00, requested image updated_at = 2021-12-11 20:39:30+00:00. {{(pid=134173) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 11 21:56:31.536495 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Creating from source image-volume 77b5072a-b5ee-4761-8a94-97ee1dfb3e78 {{(pid=134173) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 11 21:56:31.547310 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:56:31.597995 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] creating snapshot='volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a.clone_snap' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 11 21:56:32.238986 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] cloning 'volume-77b5072a-b5ee-4761-8a94-97ee1dfb3e78@volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a.clone_snap' to 'volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a' {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 11 21:56:32.377800 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Volume volume-dc518867-b86b-43da-a7ed-f4805e120bdf.deleted is not a clone. {{(pid=134173) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 11 21:56:32.378935 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 11 21:56:32.379368 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134173) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 11 21:56:32.396562 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] clone created successfully {{(pid=134173) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 11 21:56:32.397193 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.volume_utils [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Marking volume d09a9fe3-9a30-44e0-9d8f-f30bf776750a as bootable. {{(pid=134173) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 11 21:56:32.404767 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Copying metadata from image 659d8dfa-8ba1-483c-93c0-647553900999 to d09a9fe3-9a30-44e0-9d8f-f30bf776750a. {{(pid=134173) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 11 21:56:32.405244 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Creating volume glance metadata for volume d09a9fe3-9a30-44e0-9d8f-f30bf776750a backed by image 659d8dfa-8ba1-483c-93c0-647553900999 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134173) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 11 21:56:32.450905 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2e0ffe-59ff-4d5f-a072-ec1bce3cb9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a', 'volume_size': 1, 'image_id': '659d8dfa-8ba1-483c-93c0-647553900999', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9abd4ac430f4576a95df91cf526b465', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '659d8dfa-8ba1-483c-93c0-647553900999', 'created_at': datetime.datetime(2021, 12, 11, 20, 39, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 11, 20, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/659d8dfa-8ba1-483c-93c0-647553900999/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:56:32.453075 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6b4004-5a3b-40f7-80f6-1370463160d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 11 21:56:32.461060 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.flows.manager.create_volume [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Volume volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a (d09a9fe3-9a30-44e0-9d8f-f30bf776750a): created successfully Dec 11 21:56:32.463300 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6b4004-5a3b-40f7-80f6-1370463160d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134173) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 11 21:56:32.466330 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Flow 'volume_create_manager' (25f29a0f-5210-4666-94a6-18b0b1053775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134173) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 11 21:56:32.473433 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [None req-77f8abb7-10df-4e32-8259-415dee130b60 tempest-TestShelveInstance-505849774 None] Created volume successfully. Dec 11 21:56:39.576963 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-a60cedce-1b2a-418c-a735-c384ba726744 req-61107b96-93f2-4674-8227-c81ecd33146f tempest-TestShelveInstance-505849774 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:56:40.229576 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-a60cedce-1b2a-418c-a735-c384ba726744 req-61107b96-93f2-4674-8227-c81ecd33146f tempest-TestShelveInstance-505849774 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.652s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:56:40.230542 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-a60cedce-1b2a-418c-a735-c384ba726744 req-61107b96-93f2-4674-8227-c81ecd33146f tempest-TestShelveInstance-505849774 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'd09a9fe3-9a30-44e0-9d8f-f30bf776750a', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:56:40.262254 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-a60cedce-1b2a-418c-a735-c384ba726744 req-61107b96-93f2-4674-8227-c81ecd33146f tempest-TestShelveInstance-505849774 None] Connection info returned from driver {'name': 'volumes/volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd09a9fe3-9a30-44e0-9d8f-f30bf776750a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ec0b00bd-82a0-4c90-91f4-178ccffc8732'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:56:40.316147 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-a60cedce-1b2a-418c-a735-c384ba726744 req-61107b96-93f2-4674-8227-c81ecd33146f tempest-TestShelveInstance-505849774 None] attachment_update completed successfully. Dec 11 21:56:55.868146 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:56:55.869079 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:56:55.892585 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:56:55.925321 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:57:55.871931 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:57:55.872729 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:57:55.897607 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:57:55.925592 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:58:55.873384 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:58:55.874087 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:58:55.894747 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:58:55.916945 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 21:59:11.305231 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-216252dc-d65f-461c-a214-32f2b5a3074e req-4dad5d71-5013-47bf-acc8-2d4e93477633 tempest-TestShelveInstance-505849774 None] Terminate volume connection completed successfully. Dec 11 21:59:11.305904 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-216252dc-d65f-461c-a214-32f2b5a3074e req-4dad5d71-5013-47bf-acc8-2d4e93477633 tempest-TestShelveInstance-505849774 None] Deleting attachment ec0b00bd-82a0-4c90-91f4-178ccffc8732. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 21:59:12.552504 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-403b3d46-1be7-4806-b9c7-eb4889c030c6 req-b518a88b-bcd2-424d-a853-1dfa7863c86b tempest-TestShelveInstance-505849774 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 11 21:59:13.194247 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_concurrency.processutils [req-403b3d46-1be7-4806-b9c7-eb4889c030c6 req-b518a88b-bcd2-424d-a853-1dfa7863c86b tempest-TestShelveInstance-505849774 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.641s {{(pid=134173) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 11 21:59:13.195135 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-403b3d46-1be7-4806-b9c7-eb4889c030c6 req-b518a88b-bcd2-424d-a853-1dfa7863c86b tempest-TestShelveInstance-505849774 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '165df680-4878-464e-9553-140cfde358a5', 'volume_id': 'd09a9fe3-9a30-44e0-9d8f-f30bf776750a', 'discard': True}} {{(pid=134173) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 11 21:59:13.218023 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-403b3d46-1be7-4806-b9c7-eb4889c030c6 req-b518a88b-bcd2-424d-a853-1dfa7863c86b tempest-TestShelveInstance-505849774 None] Connection info returned from driver {'name': 'volumes/volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd09a9fe3-9a30-44e0-9d8f-f30bf776750a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '830c51cb-4dc4-4355-988b-172a41d4be30'} {{(pid=134173) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 11 21:59:13.271391 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-403b3d46-1be7-4806-b9c7-eb4889c030c6 req-b518a88b-bcd2-424d-a853-1dfa7863c86b tempest-TestShelveInstance-505849774 None] attachment_update completed successfully. Dec 11 21:59:55.871861 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 21:59:55.873356 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:59:55.900530 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 21:59:55.925497 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:00:44.739594 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-4a88d45c-940c-43f2-ac64-34b6f5ab7693 tempest-TestShelveInstance-505849774 None] Terminate volume connection completed successfully. Dec 11 22:00:44.740590 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.manager [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-4a88d45c-940c-43f2-ac64-34b6f5ab7693 tempest-TestShelveInstance-505849774 None] Deleting attachment 830c51cb-4dc4-4355-988b-172a41d4be30. {{(pid=134173) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 11 22:00:44.859954 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-52d36e29-2d9a-4082-96d3-31ca54deefdd tempest-TestShelveInstance-505849774 None] Lock "b'cinder-d09a9fe3-9a30-44e0-9d8f-f30bf776750a-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 11 22:00:44.894909 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-52d36e29-2d9a-4082-96d3-31ca54deefdd tempest-TestShelveInstance-505849774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:00:44.972321 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-52d36e29-2d9a-4082-96d3-31ca54deefdd tempest-TestShelveInstance-505849774 None] volume has no backup snaps {{(pid=134173) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 11 22:00:44.979406 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-52d36e29-2d9a-4082-96d3-31ca54deefdd tempest-TestShelveInstance-505849774 None] deleting rbd volume volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 11 22:00:45.272558 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-52d36e29-2d9a-4082-96d3-31ca54deefdd tempest-TestShelveInstance-505849774 None] volume is a clone so cleaning references {{(pid=134173) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 11 22:00:45.307732 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-52d36e29-2d9a-4082-96d3-31ca54deefdd tempest-TestShelveInstance-505849774 None] deleting parent snapshot volume-d09a9fe3-9a30-44e0-9d8f-f30bf776750a.clone_snap {{(pid=134173) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 11 22:00:46.375092 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.quota [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-52d36e29-2d9a-4082-96d3-31ca54deefdd tempest-TestShelveInstance-505849774 None] Created reservations ['d76b5b5a-a439-4aac-8a2c-66445e74dd92', '9b2e8699-07f8-4020-9943-7759af24536a', 'a3a86789-1c40-486b-809f-ba39257e1c9c', 'cb125b4c-8026-4711-b87f-78587fbaa463'] {{(pid=134173) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 11 22:00:46.418046 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-52d36e29-2d9a-4082-96d3-31ca54deefdd tempest-TestShelveInstance-505849774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:00:46.448676 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-52d36e29-2d9a-4082-96d3-31ca54deefdd tempest-TestShelveInstance-505849774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:00:46.547685 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-52d36e29-2d9a-4082-96d3-31ca54deefdd tempest-TestShelveInstance-505849774 None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:00:46.547685 ncdv-master-1 cinder-volume[134173]: INFO cinder.volume.manager [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-52d36e29-2d9a-4082-96d3-31ca54deefdd tempest-TestShelveInstance-505849774 None] Deleted volume successfully. Dec 11 22:00:46.550831 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.coordination [req-5a464727-3575-4b11-856a-1a1cc68b62b5 req-52d36e29-2d9a-4082-96d3-31ca54deefdd tempest-TestShelveInstance-505849774 None] Lock "b'cinder-d09a9fe3-9a30-44e0-9d8f-f30bf776750a-delete_volume'" released by "delete_volume" :: held 1.691s {{(pid=134173) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 11 22:00:55.871860 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:00:55.872760 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:00:55.916250 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:00:55.957841 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:01:55.875683 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:01:55.876268 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:01:55.898261 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:01:55.919533 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:02:55.875011 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:02:55.875629 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:02:55.897059 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:02:55.919357 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:03:55.874541 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:03:55.875263 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:03:55.898205 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:03:55.927955 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:04:55.873424 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:04:55.874118 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:04:55.902628 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:04:55.924320 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:05:55.870411 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:05:55.871351 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:05:55.892234 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:05:55.913353 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:06:55.868346 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:06:55.869024 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:06:55.890411 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:06:55.912098 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:07:55.867168 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:07:55.867820 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:07:55.888999 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:07:55.910642 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:08:55.866252 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:08:55.866946 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:08:55.889455 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:08:55.911986 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:09:55.867163 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:09:55.867811 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:09:55.888907 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:09:55.911167 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:10:55.867171 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:10:55.867850 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:10:55.889622 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:10:55.911529 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:11:55.866712 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:11:55.867364 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:11:55.888347 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:11:55.909903 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:12:55.866441 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:12:55.867158 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:12:55.895315 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:12:55.918913 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 11 22:13:55.864178 ncdv-master-1 cinder-volume[134173]: DEBUG oslo_service.periodic_task [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134173) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 11 22:13:55.864903 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:13:55.886920 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.volume.drivers.rbd [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134173) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 11 22:13:55.911035 ncdv-master-1 cinder-volume[134173]: DEBUG cinder.manager [None req-7bcfe71e-701f-477e-836e-13413208b594 None None] Notifying Schedulers of capabilities ... {{(pid=134173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}