-- Logs begin at Mon 2022-05-02 09:16:05 UTC, end at Mon 2022-05-02 11:53:34 UTC. -- May 02 10:09:37.418677 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. May 02 10:09:41.137144 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=123611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 02 10:09:41.137716 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=123611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 02 10:09:41.526421 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_db.sqlalchemy.engines [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 02 10:09:41.837289 ncdv-master-1 cinder-volume[123611]: INFO cinder.rpc [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. May 02 10:09:41.842198 ncdv-master-1 cinder-volume[123611]: INFO cinder.rpc [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. May 02 10:09:41.849728 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_db.sqlalchemy.engines [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 02 10:09:41.916303 ncdv-master-1 cinder-volume[123611]: INFO cinder.volume.manager [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Determined volume DB was empty at startup. May 02 10:09:41.917092 ncdv-master-1 cinder-volume[123611]: DEBUG cinder.volume.manager [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=123611) __init__ /opt/stack/cinder/cinder/volume/manager.py:286}} May 02 10:09:41.925635 ncdv-master-1 cinder-volume[123611]: INFO cinder.volume.manager [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Service not found for updating active_backend_id, assuming default for driver init. May 02 10:09:41.926546 ncdv-master-1 cinder-volume[123611]: WARNING stevedore.named [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 02 10:09:41.927091 ncdv-master-1 cinder-volume[123611]: WARNING castellan.key_manager [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 02 10:09:41.928302 ncdv-master-1 cinder-volume[123611]: WARNING cinder.keymgr.conf_key_mgr [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 02 10:09:41.945974 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_db.sqlalchemy.engines [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 02 10:09:41.950625 ncdv-master-1 cinder-volume[123611]: INFO cinder.rpc [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. May 02 10:09:41.955593 ncdv-master-1 cinder-volume[123611]: INFO cinder.rpc [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. May 02 10:09:41.956333 ncdv-master-1 cinder-volume[123611]: WARNING stevedore.named [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 02 10:09:41.956915 ncdv-master-1 cinder-volume[123611]: WARNING castellan.key_manager [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 02 10:09:41.958723 ncdv-master-1 cinder-volume[123611]: INFO cinder.volume.manager [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Image-volume cache enabled for host ncdv-master-1@ceph. May 02 10:09:41.964236 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_db.sqlalchemy.engines [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 02 10:09:42.053527 ncdv-master-1 cinder-volume[123611]: INFO oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Starting 1 workers May 02 10:09:42.059397 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Started child 123784 {{(pid=123611) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} May 02 10:09:42.060904 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Full set of CONF: {{(pid=123611) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} May 02 10:09:42.061634 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ******************************************************************************** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 02 10:09:42.062192 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] Configuration options gathered from: {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 02 10:09:42.062732 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 02 10:09:42.063555 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 02 10:09:42.064007 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ================================================================================ {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 02 10:09:42.065016 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] allow_availability_zone_fallback = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.065578 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] allow_compression_on_image_upload = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.066453 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] allowed_direct_url_schemes = [] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.067023 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] api_rate_limit = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.067695 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] auth_strategy = keystone {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.068531 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] az_cache_duration = 3600 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.069240 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_availability_zone = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.069849 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_host = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.070498 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_name = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.071054 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_stats_polling_interval = 60 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.071636 ncdv-master-1 cinder-volume[123784]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0) May 02 10:09:42.072344 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backup_api_class = cinder.backup.api.API {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.073145 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.073744 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backup_name_template = backup-%s {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.074356 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backup_use_same_host = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.074913 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backup_use_temp_snapshot = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.075491 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] chap_password = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.076018 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] chap_username = {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.076768 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.077390 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cinder_internal_tenant_project_id = 972cae0aa9694d6cad22fbdbcf916ff7 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.078631 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cinder_internal_tenant_user_id = 8eab371b02c34a13b629eacdf504dbdb {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.079309 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cloned_volume_same_az = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.079829 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cluster = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.080490 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] compression_format = gzip {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.081088 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] compute_api_class = cinder.compute.nova.API {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.081832 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] config_dir = [] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.082303 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.082903 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] config_source = [] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.083436 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.084047 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] control_exchange = openstack {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.084657 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] debug = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.085185 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] default_availability_zone = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.085739 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] default_group_type = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.086844 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.089286 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] default_volume_type = ceph {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.089286 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] driver_client_cert = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.089286 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] driver_client_cert_key = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.089286 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] driver_data_namespace = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.089286 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] driver_ssl_cert_path = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.090236 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] driver_ssl_cert_verify = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.090883 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] driver_use_ssl = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.091449 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] enable_force_upload = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.092095 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] enable_new_services = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.092638 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] enable_unsupported_driver = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.093199 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] enabled_backends = ['ceph'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.094385 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] enforce_multipath_for_image_xfer = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.094893 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] filter_function = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.095465 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] glance_api_insecure = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.096004 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] glance_api_servers = ['http://10.222.0.16/image'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.096550 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] glance_api_ssl_compression = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.097345 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] glance_ca_certificates_file = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.098193 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] glance_catalog_info = image:glance:publicURL {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.101027 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] glance_certfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.101027 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.101703 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] glance_keyfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.102446 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] glance_num_retries = 3 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.102991 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] glance_request_timeout = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.103513 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] goodness_function = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.104062 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] graceful_shutdown_timeout = 5 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.104587 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] group_api_class = cinder.group.api.API {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.105000 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Starting volume driver RBDDriver (1.2.0) May 02 10:09:42.105241 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] host = ncdv-master-1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.105805 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] iet_conf = /etc/iet/ietd.conf {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.106348 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] image_compress_on_upload = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.106994 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] image_conversion_address_space_limit = 1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.107268 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:09:42.107758 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] image_conversion_cpu_limit = 60 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.108516 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.109239 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] image_upload_use_cinder_backend = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.109787 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] image_upload_use_internal_tenant = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.110510 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] image_volume_cache_enabled = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.111018 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] image_volume_cache_max_count = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.111703 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] image_volume_cache_max_size_gb = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.112444 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] init_host_max_objects_retrieval = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.113034 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] instance_format = [instance: %(uuid)s] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.113651 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.114200 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] iscsi_iotype = fileio {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.114779 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] iscsi_secondary_ip_addresses = [] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.115740 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] iscsi_target_flags = {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.116266 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] iscsi_write_cache = on {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.116900 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] iser_helper = tgtadm {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.117835 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] iser_ip_address = 10.222.0.16 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.118419 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] iser_port = 3260 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.119173 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.119731 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] log_config_append = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.120403 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.120941 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] log_dir = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.121458 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] log_file = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.122044 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] log_options = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.122943 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] log_rotate_interval = 1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.123511 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] log_rotate_interval_type = days {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.124091 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] log_rotation_type = none {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.124552 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.125067 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.125528 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.125916 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.126265 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.126818 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] max_age = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.127260 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] max_logfile_count = 30 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.127716 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] max_logfile_size_mb = 200 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.128135 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] max_over_subscription_ratio = 20.0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.128530 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] message_reap_interval = 86400 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.129235 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] message_ttl = 2592000 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.129632 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] migration_create_volume_timeout_secs = 300 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.130062 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] monkey_patch = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.130518 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] monkey_patch_modules = [] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.130831 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] my_ip = 10.222.0.16 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.131225 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] no_snapshot_gb_quota = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.131762 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] num_iser_scan_tries = 3 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.132306 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] num_shell_tries = 3 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.132685 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] num_volume_device_scan_tries = 3 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.133330 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] nvmet_ns_id = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.133542 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] nvmet_port_id = 1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.133967 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] osapi_max_limit = 1000 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.134386 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] osapi_volume_ext_list = [] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.134817 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.135365 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] osapi_volume_listen = 0.0.0.0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.136204 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] osapi_volume_listen_port = 8776 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.137024 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] osapi_volume_use_ssl = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.137597 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] osapi_volume_workers = 2 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.138174 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] per_volume_size_limit = -1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.138313 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] periodic_fuzzy_delay = 60 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.138703 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] periodic_interval = 60 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.139116 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] project_id_regex = [0-9a-f\-]+ {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.139612 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] public_endpoint = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.139999 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] publish_errors = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.141070 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] quota_backup_gigabytes = 1000 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.141436 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] quota_backups = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.141784 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] quota_consistencygroups = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.142333 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.142875 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] quota_gigabytes = 1000 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.143532 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] quota_groups = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.144052 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] quota_snapshots = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.144587 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] quota_volumes = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.145161 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] rate_limit_burst = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.145685 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] rate_limit_except_level = CRITICAL {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.146215 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] rate_limit_interval = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.146712 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] reinit_driver_count = 3 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.147251 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] replication_device = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.147762 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] report_discard_supported = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.148296 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] report_interval = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.148937 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] reservation_clean_interval = 86400 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.149500 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] reservation_expire = 86400 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.150034 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] reserved_percentage = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.150592 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.151229 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.151661 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] rpc_response_timeout = 120 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.152015 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] run_external_periodic_tasks = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.152392 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.152815 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] scst_target_driver = iscsi {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.153163 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] scst_target_iqn_name = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.153595 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] service_down_time = 60 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.153992 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] snapshot_name_template = snapshot-%s {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.154361 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] snapshot_same_host = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.154720 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] split_loggers = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.155016 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] state_path = /opt/stack/data/cinder {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.155398 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] storage_availability_zone = nova {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.156421 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] storage_protocol = iSCSI {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.156839 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] syslog_log_facility = LOG_USER {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.157214 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] target_helper = lioadm {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.157666 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] target_ip_address = 10.222.0.16 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.158027 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] target_port = 3260 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.158387 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.158758 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] target_protocol = iscsi {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.159130 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] trace_flags = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.159630 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] transfer_api_class = cinder.transfer.api.API {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.160009 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] transport_url = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.160363 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] until_refresh = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.160739 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] use_chap_auth = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.161260 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] use_default_quota_class = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.161777 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] use_eventlog = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.162305 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] use_journal = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.162900 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] use_json = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.163548 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] use_multipath_for_image_xfer = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.164059 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] use_stderr = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.164422 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] use_syslog = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.164867 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] verify_glance_signatures = enabled {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.165232 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volume_api_class = cinder.volume.api.API {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.165583 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volume_backend_name = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.165980 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volume_clear = zero {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.166323 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volume_clear_ionice = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.166671 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volume_clear_size = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.167041 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.167391 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volume_copy_bps_limit = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.167893 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volume_dd_blocksize = 1M {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.168141 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.168506 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volume_name_template = volume-%s {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.168896 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volume_service_inithost_offload = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.169294 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volume_usage_audit_period = month {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.169775 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.170128 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] watch_log_file = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.170490 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] zoning_mode = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 10:09:42.171000 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.171736 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.172174 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_policy.enforce_new_defaults = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.172552 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_policy.enforce_scope = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.172954 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_policy.policy_default_rule = default {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.173364 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.173960 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_policy.policy_file = policy.yaml {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.174395 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.174744 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.175135 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.175480 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.175814 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.176384 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_concurrency.disable_process_locking = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.177000 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.177621 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.admin_password = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.178156 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.178510 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.admin_token = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.178861 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.admin_user = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.179263 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.auth_admin_prefix = {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.179630 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.180022 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.auth_port = 35357 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.180414 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.auth_protocol = https {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.180858 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.auth_section = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.181274 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.auth_type = password {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.181642 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.auth_uri = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.182034 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.auth_version = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.182369 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.cache = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.182755 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.183105 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.certfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.183462 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.delay_auth_decision = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.183874 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.184223 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.http_connect_timeout = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.184574 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.186552 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.identity_uri = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.187615 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.include_service_catalog = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.188170 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.insecure = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.188566 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.interface = public {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.188964 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.keyfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.189332 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.189706 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.190069 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.190438 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.190818 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.191165 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.191546 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.191930 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.192346 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.192738 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.region_name = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.193128 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.193485 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.service_token_roles_required = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.193838 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.service_type = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.194197 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.token_cache_time = 300 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.194576 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.195059 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.backend = dogpile.cache.null {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.195448 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.backend_argument = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.195841 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.config_prefix = cache.oslo {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.196305 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.dead_timeout = 60.0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.196733 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.debug_cache_backend = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.197091 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.enable_retry_client = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.197473 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.enable_socket_keepalive = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.197810 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.enabled = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.198148 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.expiration_time = 600 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.198503 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.hashclient_retry_attempts = 2 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.198863 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.hashclient_retry_delay = 1.0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.199216 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.memcache_dead_retry = 300 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.199630 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.200024 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.200373 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.memcache_pool_maxsize = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.200769 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.201485 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.202143 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.memcache_socket_timeout = 1.0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.203339 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.proxies = [] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.203848 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.retry_attempts = 2 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.204350 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.retry_delay = 0.0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.204900 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.socket_keepalive_count = 1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.205165 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:09:42.205276 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.socket_keepalive_idle = 1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.205603 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.socket_keepalive_interval = 1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.205950 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.tls_allowed_ciphers = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.206303 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.tls_cafile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.206655 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.tls_certfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.207011 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.tls_enabled = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.207366 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cache.tls_keyfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.207769 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] coordination.backend_url = etcd3+http://10.222.0.16:2379 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.208231 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.backend = sqlalchemy {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.208536 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.connection = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.208939 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.connection_debug = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.209312 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.connection_parameters = {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.209682 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.connection_recycle_time = 3600 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.210051 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.connection_trace = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.210409 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.db_inc_retry_interval = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.210764 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.db_max_retries = 20 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.211120 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.db_max_retry_interval = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.211477 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.db_retry_interval = 1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.211837 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.max_overflow = 50 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.212193 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.max_pool_size = 5 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.212552 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.max_retries = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.212925 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.mysql_enable_ndb = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.213293 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.213646 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.pool_timeout = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.214010 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.retry_interval = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.214380 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.slave_connection = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.214740 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.sqlite_synchronous = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.215095 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] database.use_db_reconnect = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.215489 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.215838 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.216211 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.216577 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.216958 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.217397 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] profiler.connection_string = messaging:// {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.217711 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] profiler.enabled = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.218272 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] profiler.es_doc_type = notification {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.218632 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] profiler.es_scroll_size = 10000 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.218997 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] profiler.es_scroll_time = 2m {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.219347 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] profiler.filter_error_trace = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.219715 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] profiler.hmac_keys = SECRET_KEY {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.220084 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] profiler.sentinel_service_name = mymaster {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.220447 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] profiler.socket_timeout = 0.1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.225306 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] profiler.trace_sqlalchemy = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.225306 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] privsep_osbrick.capabilities = [21] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.225306 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] privsep_osbrick.group = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.225306 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] privsep_osbrick.helper_command = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.225306 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.225306 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.225306 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] privsep_osbrick.user = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.226389 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.226389 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cinder_sys_admin.group = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.226389 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cinder_sys_admin.helper_command = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.226389 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.226389 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.226389 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] cinder_sys_admin.user = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.226389 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] service_user.auth_section = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.227498 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] service_user.auth_type = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.227498 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] service_user.cafile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.227498 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] service_user.certfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.227498 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] service_user.collect_timing = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.227498 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] service_user.insecure = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.227498 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] service_user.keyfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.228429 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] service_user.send_service_user_token = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.228429 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] service_user.split_loggers = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.228776 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] service_user.timeout = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.229064 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.backend_availability_zone = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.229597 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.230120 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.230664 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.chap_password = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.231220 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.chap_username = {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.231754 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.232296 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.232792 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.233130 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.driver_client_cert = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.233640 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.driver_client_cert_key = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.234036 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.driver_data_namespace = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.234388 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.234766 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.235123 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.driver_use_ssl = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.235483 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.enable_deferred_deletion = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.235857 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.enable_unsupported_driver = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.236217 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.236586 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.extra_capabilities = {} {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.237035 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.filter_function = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.237295 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.goodness_function = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.237662 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.238025 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.238375 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.238727 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.239080 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.239435 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.240229 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.iscsi_iotype = fileio {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.240885 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.241280 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.iscsi_target_flags = {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.241948 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.iscsi_write_cache = on {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.242329 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.iser_helper = tgtadm {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.242863 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.iser_ip_address = 10.222.0.16 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.243227 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.iser_port = 3260 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.243596 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.243973 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.244335 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.244718 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.num_shell_tries = 3 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.245131 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.245424 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.245933 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.nvmet_port_id = 1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.246475 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.246996 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.rados_connection_interval = 5 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.247361 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.rados_connection_retries = 3 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.247731 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.rbd_ceph_conf = {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.248290 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.248818 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.249380 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.250419 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.250961 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.rbd_pool = rbd {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.251465 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.rbd_secret_uuid = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.251988 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.252363 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.rbd_user = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.252762 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.253125 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.replication_device = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.253484 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.report_discard_supported = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.253840 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.254202 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.reserved_percentage = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.254574 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.scst_target_driver = iscsi {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.254919 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.scst_target_iqn_name = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.255289 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.storage_protocol = iSCSI {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.255641 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.256009 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.target_helper = tgtadm {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.256488 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.target_ip_address = 10.222.0.16 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.256885 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.target_port = 3260 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.257291 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.257620 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.target_protocol = iscsi {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.257977 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.trace_flags = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.258330 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.unique_fqdn_network = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.258684 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.use_chap_auth = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.259043 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.259389 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.volume_backend_name = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.259779 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.volume_clear = zero {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.260118 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.volume_clear_ionice = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.260485 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.volume_clear_size = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.262353 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.262677 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.263051 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.263608 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.264083 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.264496 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_reports.file_event_handler = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.264918 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.265931 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_reports.log_dir = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.266397 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.backend_availability_zone = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.266759 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.backend_host = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.267123 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.backend_native_threads_pool_size = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.267481 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.backup_use_temp_snapshot = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.267765 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:09:42.267878 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.chap_password = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.268182 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.chap_username = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.268538 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.chiscsi_conf = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.268923 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.deferred_deletion_delay = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.269278 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.deferred_deletion_purge_interval = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.269629 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.driver_client_cert = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.269987 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.driver_client_cert_key = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.270335 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.driver_data_namespace = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.270693 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.driver_ssl_cert_path = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.271051 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.driver_ssl_cert_verify = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.271405 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.driver_use_ssl = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.271751 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.enable_deferred_deletion = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.272101 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.enable_unsupported_driver = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.272455 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.272828 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.extra_capabilities = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.273183 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.filter_function = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.273533 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.goodness_function = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.273872 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.iet_conf = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.274403 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.image_upload_use_cinder_backend = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.274802 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.image_upload_use_internal_tenant = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.275174 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.image_volume_cache_enabled = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.275526 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.image_volume_cache_max_count = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.275877 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.276225 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.iscsi_iotype = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.276568 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.277181 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.iscsi_target_flags = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.277710 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.iscsi_write_cache = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.278069 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.iser_helper = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.278425 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.iser_ip_address = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.278770 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.iser_port = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.279260 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.iser_target_prefix = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.279757 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.max_over_subscription_ratio = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.280264 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.num_iser_scan_tries = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.280817 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.num_shell_tries = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288404 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.num_volume_device_scan_tries = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288404 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.nvmet_ns_id = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288404 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.nvmet_port_id = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288404 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.rados_connect_timeout = -1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288404 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.rados_connection_interval = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288404 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.rados_connection_retries = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288404 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288935 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.rbd_cluster_name = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288935 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288935 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288935 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.rbd_max_clone_depth = 5 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288935 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.rbd_pool = volumes {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.288935 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.rbd_secret_uuid = f5809a2c-f35a-4b72-b096-a4cf6b0e2893 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.289334 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.rbd_store_chunk_size = 4 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.289334 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.rbd_user = cinder {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.289334 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.replication_connect_timeout = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.289334 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.replication_device = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.289334 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.report_discard_supported = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.289334 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.report_dynamic_total_capacity = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.289334 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.reserved_percentage = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.289783 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.scst_target_driver = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.289783 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.scst_target_iqn_name = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.289783 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.storage_protocol = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.289783 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.289783 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.target_helper = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.290089 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.target_ip_address = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.290156 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.target_port = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.290493 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.target_prefix = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.291014 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.target_protocol = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.291364 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.trace_flags = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.291708 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.unique_fqdn_network = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.292058 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.use_chap_auth = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.292408 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.use_multipath_for_image_xfer = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.292804 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.volume_backend_name = ceph {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.293152 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.volume_clear = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.293516 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.volume_clear_ionice = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.293862 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.volume_clear_size = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.294212 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.294561 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.volume_copy_bps_limit = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.294902 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.volume_dd_blocksize = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.295266 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.295791 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ceph.volumes_dir = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.296246 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.296692 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.297237 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.297613 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.297994 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.298523 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.298895 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.299408 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.299943 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.300291 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.300726 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.301453 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.301749 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.302117 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.302471 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.302850 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.303217 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.303637 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.303994 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.304350 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.304755 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.305271 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.305868 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.ssl = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.306245 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.306647 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.307025 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.307396 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_rabbit.ssl_version = {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.307901 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_notifications.driver = [] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.308310 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_notifications.retry = -1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.308768 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.308875 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.driver [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Driver hasn't implemented _init_vendor_properties() May 02 10:09:42.309132 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] oslo_messaging_notifications.transport_url = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.309264 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.driver [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:075422a1-5ad9-4b19-bac0-40a65c7914b1:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=123784) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}} May 02 10:09:42.309486 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.309786 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] key_manager.fixed_key = **** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.310221 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.310599 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.barbican_api_version = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.310956 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.barbican_endpoint = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.311347 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.barbican_endpoint_type = public {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.311696 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.barbican_region_name = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.312583 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.cafile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.312973 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.certfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.313352 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.collect_timing = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.313705 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.insecure = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.314047 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.keyfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.314432 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.number_of_retries = 60 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.314780 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.retry_delay = 1 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.315134 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.send_service_user_token = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.315489 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.split_loggers = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.315831 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.timeout = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.316181 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.verify_ssl = True {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.316525 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican.verify_ssl_path = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.316913 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican_service_user.auth_section = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.317271 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican_service_user.auth_type = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.317968 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican_service_user.cafile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.318469 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican_service_user.certfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.318676 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican_service_user.collect_timing = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.319024 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican_service_user.insecure = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.319532 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican_service_user.keyfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.320068 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican_service_user.split_loggers = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.320582 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] barbican_service_user.timeout = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.320993 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.approle_role_id = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.321355 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.approle_secret_id = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.321726 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.cafile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.328545 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.certfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.328545 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.collect_timing = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.328545 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.insecure = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.328545 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.keyfile = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.328545 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.kv_mountpoint = secret {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.328545 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.kv_version = 2 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.328545 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.namespace = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.329171 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_db.sqlalchemy.engines [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123784) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 02 10:09:42.329260 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.root_token_id = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.329260 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.split_loggers = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.329260 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.ssl_ca_crt_file = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.329260 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.timeout = None {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.329260 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.use_ssl = False {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.329260 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 10:09:42.329706 ncdv-master-1 cinder-volume[123611]: DEBUG oslo_service.service [None req-4835463e-eb44-4206-81cd-1d8067df4536 None None] ******************************************************************************** {{(pid=123611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 02 10:09:42.364078 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.db.sqlalchemy.api [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Building query based on filter {{(pid=123784) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3459}} May 02 10:09:42.385407 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.image_utils [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=123784) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} May 02 10:09:42.393014 ncdv-master-1 cinder-volume[123784]: INFO cinder.keymgr.migration [None req-35230265-80c2-43d1-a2c7-d0721e7e1eb8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. May 02 10:09:42.401583 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:09:42.428521 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:09:42.468279 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:09:42.497115 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Driver initialization completed successfully. May 02 10:09:42.498057 ncdv-master-1 cinder-volume[123784]: INFO cinder.manager [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Initiating service 3 cleanup May 02 10:09:42.507691 ncdv-master-1 cinder-volume[123784]: INFO cinder.manager [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Service 3 cleanup completed. May 02 10:09:42.508053 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.service [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Creating RPC server for service cinder-volume {{(pid=123784) start /opt/stack/cinder/cinder/service.py:231}} May 02 10:09:42.517059 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.service [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=123784) start /opt/stack/cinder/cinder/service.py:237}} May 02 10:09:42.574432 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) May 02 10:09:42.575543 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:09:42.600978 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:09:42.707584 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-665f8040-078e-43dd-a781-1d0794aa2575 None None] Driver post RPC initialization completed successfully. May 02 10:10:58.710997 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:10:58.711838 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:10:58.736052 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:10:58.761719 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:11:58.707068 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:11:58.707777 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:11:58.732343 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:11:58.806672 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:12:58.711655 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:12:58.712364 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:12:58.757240 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:12:58.780437 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:13:58.715134 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:13:58.715822 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:13:58.791950 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:13:58.886708 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:14:58.711667 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:14:58.712447 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:14:58.734368 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:14:58.754981 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:15:58.710200 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:15:58.710899 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:15:58.733854 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:15:58.759127 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:16:58.714240 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:16:58.714959 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:16:58.735948 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:16:58.757946 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:17:58.714231 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:17:58.723278 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:17:58.784230 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:17:58.814348 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:18:58.714353 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:18:58.715535 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:18:58.751490 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:18:58.781565 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:19:58.717801 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:19:58.718492 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:19:58.896675 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:19:59.006785 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:20:58.722363 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:20:58.723077 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:20:58.796803 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:20:58.858276 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:21:29.262275 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:21:29.408364 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Flow 'volume_create_manager' (00ff3beb-ae65-4118-9bc7-193d69a6804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:21:29.434816 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c627a1-95ad-44fa-947a-8674d1ff5382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:29.591624 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c627a1-95ad-44fa-947a-8674d1ff5382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-457058784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cae75812-17f0-4284-96d9-ee945957a3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6f08a44c6448529e12c65f5c01384c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:21:29Z,use_quota=True,user_id='5a4826566d7d486db4e9fd217bccac2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:29.605403 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02e89c9-9cfd-4d4a-9c57-81f8c35a0543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:29.610144 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02e89c9-9cfd-4d4a-9c57-81f8c35a0543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:29.616355 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce5f4d6-cd99-4d29-9293-d4df48d4986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:29.628166 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce5f4d6-cd99-4d29-9293-d4df48d4986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae75812-17f0-4284-96d9-ee945957a3bc', 'volume_name': 'volume-cae75812-17f0-4284-96d9-ee945957a3bc', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:29.636315 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32037fe-f273-4563-90aa-e0166d506ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:29.641015 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32037fe-f273-4563-90aa-e0166d506ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:29.646592 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604583e2-1b9c-40e1-982f-4272ad8249d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:29.647905 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Volume cae75812-17f0-4284-96d9-ee945957a3bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae75812-17f0-4284-96d9-ee945957a3bc', 'volume_size': 1} May 02 10:21:29.648549 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] creating volume 'volume-cae75812-17f0-4284-96d9-ee945957a3bc' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:21:29.649731 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:21:30.533564 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:21:30.534730 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:21:30.539397 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604583e2-1b9c-40e1-982f-4272ad8249d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae75812-17f0-4284-96d9-ee945957a3bc', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:30.544193 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a24e99a-36e3-4170-8350-526d82470559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:30.644203 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Volume volume-cae75812-17f0-4284-96d9-ee945957a3bc (cae75812-17f0-4284-96d9-ee945957a3bc): created successfully May 02 10:21:30.648781 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a24e99a-36e3-4170-8350-526d82470559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:30.662483 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Flow 'volume_create_manager' (00ff3beb-ae65-4118-9bc7-193d69a6804b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:21:30.753213 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-087ca664-d1d2-4232-adb9-452c9128c427 tempest-VolumesAdminNegativeTest-1913665487 None] Created volume successfully. May 02 10:21:34.179631 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-cd2c7901-e554-49bc-9096-63b57e9fc508 req-22933e09-2f10-46f7-b719-4d3cb1c136a5 tempest-VolumesAdminNegativeTest-1913665487 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:21:36.507139 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-cd2c7901-e554-49bc-9096-63b57e9fc508 req-22933e09-2f10-46f7-b719-4d3cb1c136a5 tempest-VolumesAdminNegativeTest-1913665487 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.327s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:21:36.513049 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-cd2c7901-e554-49bc-9096-63b57e9fc508 req-22933e09-2f10-46f7-b719-4d3cb1c136a5 tempest-VolumesAdminNegativeTest-1913665487 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cae75812-17f0-4284-96d9-ee945957a3bc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'cae75812-17f0-4284-96d9-ee945957a3bc', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:21:36.678920 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-cd2c7901-e554-49bc-9096-63b57e9fc508 req-22933e09-2f10-46f7-b719-4d3cb1c136a5 tempest-VolumesAdminNegativeTest-1913665487 None] Connection info returned from driver {'name': 'volumes/volume-cae75812-17f0-4284-96d9-ee945957a3bc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cae75812-17f0-4284-96d9-ee945957a3bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a8dd1f5b-0911-4de3-8fff-103db725cad9'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:21:37.010522 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-cd2c7901-e554-49bc-9096-63b57e9fc508 req-22933e09-2f10-46f7-b719-4d3cb1c136a5 tempest-VolumesAdminNegativeTest-1913665487 None] attachment_update completed successfully. May 02 10:21:42.414914 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:21:42.463678 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Flow 'volume_create_manager' (f6f94b5e-1018-4017-aebc-42379383b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:21:42.481360 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a44643-ab4e-4654-b035-f1e91b6085fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:42.548368 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a44643-ab4e-4654-b035-f1e91b6085fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-518814230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=413b81a5-a091-4d1b-837b-360ca175efea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e3a228719d4cbda0507cba959f1816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:21:42Z,use_quota=True,user_id='662c15e746b84fdbb497d700c9288931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:42.592485 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5eec97-3975-4e9e-b41a-9771e84cec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:42.628500 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5eec97-3975-4e9e-b41a-9771e84cec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:42.640036 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9d02f9-0536-4ea3-9147-35f98a6eaf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:42.649786 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9d02f9-0536-4ea3-9147-35f98a6eaf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '413b81a5-a091-4d1b-837b-360ca175efea', 'volume_name': 'volume-413b81a5-a091-4d1b-837b-360ca175efea', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:42.660507 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359e9313-b043-4ca7-8d34-003c97f0eb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:42.681281 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359e9313-b043-4ca7-8d34-003c97f0eb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:42.689865 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10304403-be74-4e7f-88a3-cbad40b75d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:42.691079 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Volume 413b81a5-a091-4d1b-837b-360ca175efea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-413b81a5-a091-4d1b-837b-360ca175efea', 'volume_size': 1} May 02 10:21:42.691496 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] creating volume 'volume-413b81a5-a091-4d1b-837b-360ca175efea' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:21:42.694089 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:21:44.007846 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:21:44.007846 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:21:44.007846 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10304403-be74-4e7f-88a3-cbad40b75d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-413b81a5-a091-4d1b-837b-360ca175efea', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:44.017453 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd1268f-693b-49e2-946e-fee5382984fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:44.118622 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Volume volume-413b81a5-a091-4d1b-837b-360ca175efea (413b81a5-a091-4d1b-837b-360ca175efea): created successfully May 02 10:21:44.123456 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd1268f-693b-49e2-946e-fee5382984fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:44.148657 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Flow 'volume_create_manager' (f6f94b5e-1018-4017-aebc-42379383b047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:21:44.275328 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a274a998-1d01-4bdb-a4f9-2d2de645f86c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Created volume successfully. May 02 10:21:45.076230 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-9a1a5fcc-67ed-4b0c-8ba8-9c5461b33dfe req-31fa930e-b454-4968-9d01-827ebfbf052f tempest-VolumesAdminNegativeTest-1913665487 None] Terminate volume connection completed successfully. May 02 10:21:45.076954 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-9a1a5fcc-67ed-4b0c-8ba8-9c5461b33dfe req-31fa930e-b454-4968-9d01-827ebfbf052f tempest-VolumesAdminNegativeTest-1913665487 None] Deleting attachment a8dd1f5b-0911-4de3-8fff-103db725cad9. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:21:46.356765 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-2da2fa94-b638-4262-a86d-efe8040040cb req-aa973967-2e9a-4b66-9729-8a8250011bb2 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:21:46.404783 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:21:46.430208 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Flow 'volume_create_manager' (010c6df4-9e64-4b87-88b2-419b242fe1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:21:46.439467 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85db0f19-f1a0-4c2e-91af-df4730b465df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:46.461349 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85db0f19-f1a0-4c2e-91af-df4730b465df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1832150852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1cbc9d75-d395-469f-815a-9f92db5893d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='794ae6913d5546dbadfb32cb27b15d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:21:46Z,use_quota=True,user_id='26be0fc413e94efa9d98b869a834e69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:46.474328 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f4cf0c-ff1f-4c7e-a101-f4d3e0db9842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:46.479861 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f4cf0c-ff1f-4c7e-a101-f4d3e0db9842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:46.485939 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc194013-4d39-480b-8fb5-c892e9661beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:46.651743 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc194013-4d39-480b-8fb5-c892e9661beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1cbc9d75-d395-469f-815a-9f92db5893d4', 'volume_name': 'volume-1cbc9d75-d395-469f-815a-9f92db5893d4', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:46.665322 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebea668e-0ec2-4bea-ac0f-74f4a769b143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:46.669399 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebea668e-0ec2-4bea-ac0f-74f4a769b143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:46.679715 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af8a20c-fdc0-45d4-a3b2-2e7731d8b9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:46.680952 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Volume 1cbc9d75-d395-469f-815a-9f92db5893d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1cbc9d75-d395-469f-815a-9f92db5893d4', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:21:46.681638 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Cloning 1cbc9d75-d395-469f-815a-9f92db5893d4 from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:21:46.701261 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.019s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:21:46.720918 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Preparing cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:879}} May 02 10:21:46.722031 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:21:47.424221 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:21:47.461149 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Flow 'volume_create_manager' (a1df9896-2f35-42b1-ac0f-2bdc05a7b2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:21:47.467624 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47159a77-7ad2-47f7-8bfc-ed735e783e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:47.485661 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47159a77-7ad2-47f7-8bfc-ed735e783e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-469254567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=59ebcde5-b7c4-4d24-bedb-a3171388f03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6f08a44c6448529e12c65f5c01384c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:21:47Z,use_quota=True,user_id='5a4826566d7d486db4e9fd217bccac2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:47.501846 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d975c853-6393-4e09-adf2-e882deb96f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:47.515155 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d975c853-6393-4e09-adf2-e882deb96f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:47.524378 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6b6073-c8dc-4cc5-b5c7-d7a8cb91962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:47.529968 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6b6073-c8dc-4cc5-b5c7-d7a8cb91962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ebcde5-b7c4-4d24-bedb-a3171388f03d', 'volume_name': 'volume-59ebcde5-b7c4-4d24-bedb-a3171388f03d', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:47.536400 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075bc5fd-0cbf-434a-8f67-4fbd36f2ee62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:47.541279 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075bc5fd-0cbf-434a-8f67-4fbd36f2ee62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:47.554332 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e681e2-8e56-435a-8601-9c073fd5c214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:47.555487 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Volume 59ebcde5-b7c4-4d24-bedb-a3171388f03d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ebcde5-b7c4-4d24-bedb-a3171388f03d', 'volume_size': 1} May 02 10:21:47.555910 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] creating volume 'volume-59ebcde5-b7c4-4d24-bedb-a3171388f03d' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:21:47.556875 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:21:47.642777 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-2da2fa94-b638-4262-a86d-efe8040040cb req-aa973967-2e9a-4b66-9729-8a8250011bb2 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.289s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:21:47.643430 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-2da2fa94-b638-4262-a86d-efe8040040cb req-aa973967-2e9a-4b66-9729-8a8250011bb2 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-413b81a5-a091-4d1b-837b-360ca175efea', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '413b81a5-a091-4d1b-837b-360ca175efea', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:21:47.756006 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-2da2fa94-b638-4262-a86d-efe8040040cb req-aa973967-2e9a-4b66-9729-8a8250011bb2 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Connection info returned from driver {'name': 'volumes/volume-413b81a5-a091-4d1b-837b-360ca175efea', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '413b81a5-a091-4d1b-837b-360ca175efea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '92a3ce48-dd8e-4560-a4e9-3bac50aa9b2e'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:21:47.942294 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-2da2fa94-b638-4262-a86d-efe8040040cb req-aa973967-2e9a-4b66-9729-8a8250011bb2 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] attachment_update completed successfully. May 02 10:21:48.366959 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:21:48.367349 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:21:48.375657 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e681e2-8e56-435a-8601-9c073fd5c214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ebcde5-b7c4-4d24-bedb-a3171388f03d', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:48.385734 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97805aa-38d6-4e76-9473-c73d14e974aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:21:48.488175 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Volume volume-59ebcde5-b7c4-4d24-bedb-a3171388f03d (59ebcde5-b7c4-4d24-bedb-a3171388f03d): created successfully May 02 10:21:48.491994 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97805aa-38d6-4e76-9473-c73d14e974aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:21:48.497952 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Flow 'volume_create_manager' (a1df9896-2f35-42b1-ac0f-2bdc05a7b2d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:21:48.584929 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f85ec892-25e3-4df7-9bde-ccfd21007575 tempest-VolumesAdminNegativeTest-1913665487 None] Created volume successfully. May 02 10:21:49.605720 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] Lock "b'cinder-59ebcde5-b7c4-4d24-bedb-a3171388f03d-delete_volume'" acquired by "delete_volume" :: waited 0.053s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:21:49.787303 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:21:50.036946 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:21:50.044828 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] Volume volume-59ebcde5-b7c4-4d24-bedb-a3171388f03d is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:21:50.169193 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] deleting rbd volume volume-59ebcde5-b7c4-4d24-bedb-a3171388f03d {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:21:54.492454 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. May 02 10:21:54.496706 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. May 02 10:21:55.473023 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] Created reservations ['1a86f1a2-2a51-4b21-9153-75885e69e5a2', '8b118390-8853-423b-b436-c1ce572db011', '81b3cc34-3be0-470b-a75a-fca997c6c9d5', 'c295f041-7489-4806-af00-6653936150e4'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:21:55.779314 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:21:55.833208 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:21:55.900541 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:21:55.907984 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] Deleted volume successfully. May 02 10:21:56.103225 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7bcaa48d-8677-480b-846d-0f6109caa689 tempest-VolumesAdminNegativeTest-1913665487 None] Lock "b'cinder-59ebcde5-b7c4-4d24-bedb-a3171388f03d-delete_volume'" released by "delete_volume" :: held 6.497s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:21:56.589341 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f8b4a14f-99a3-410c-b591-1af05289de1d tempest-VolumesAdminNegativeTest-1913665487 None] Lock "b'cinder-cae75812-17f0-4284-96d9-ee945957a3bc-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:21:56.694075 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f8b4a14f-99a3-410c-b591-1af05289de1d tempest-VolumesAdminNegativeTest-1913665487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:21:56.896108 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f8b4a14f-99a3-410c-b591-1af05289de1d tempest-VolumesAdminNegativeTest-1913665487 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:21:56.896858 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f8b4a14f-99a3-410c-b591-1af05289de1d tempest-VolumesAdminNegativeTest-1913665487 None] Volume volume-cae75812-17f0-4284-96d9-ee945957a3bc is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:21:56.989610 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f8b4a14f-99a3-410c-b591-1af05289de1d tempest-VolumesAdminNegativeTest-1913665487 None] deleting rbd volume volume-cae75812-17f0-4284-96d9-ee945957a3bc {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:21:58.729599 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:21:58.731432 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:21:58.767417 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:21:58.792406 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:21:59.552949 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-b9473373-828e-4206-b99a-7054a5f4ab8a req-0115d592-7436-4b54-a19a-6b0d3fea55fa tempest-LiveAutoBlockMigrationV225Test-702811144 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:22:00.493017 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-b9473373-828e-4206-b99a-7054a5f4ab8a req-0115d592-7436-4b54-a19a-6b0d3fea55fa tempest-LiveAutoBlockMigrationV225Test-702811144 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.940s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:22:00.493804 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-b9473373-828e-4206-b99a-7054a5f4ab8a req-0115d592-7436-4b54-a19a-6b0d3fea55fa tempest-LiveAutoBlockMigrationV225Test-702811144 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-413b81a5-a091-4d1b-837b-360ca175efea', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '413b81a5-a091-4d1b-837b-360ca175efea', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:22:00.845796 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-b9473373-828e-4206-b99a-7054a5f4ab8a req-0115d592-7436-4b54-a19a-6b0d3fea55fa tempest-LiveAutoBlockMigrationV225Test-702811144 None] Connection info returned from driver {'name': 'volumes/volume-413b81a5-a091-4d1b-837b-360ca175efea', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '413b81a5-a091-4d1b-837b-360ca175efea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ed56cb50-e244-4685-8c4c-ca31c1e36cda'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:22:00.994689 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-b9473373-828e-4206-b99a-7054a5f4ab8a req-0115d592-7436-4b54-a19a-6b0d3fea55fa tempest-LiveAutoBlockMigrationV225Test-702811144 None] attachment_update completed successfully. May 02 10:22:01.453865 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-f8b4a14f-99a3-410c-b591-1af05289de1d tempest-VolumesAdminNegativeTest-1913665487 None] Created reservations ['40e945ac-36fe-417f-bd8f-ef56a63ec93e', '5288e63d-b0c9-4d6d-b5d3-e6cda9f12ae0', '264049a6-bd32-4e80-8fb5-4add47fa60bf', '703b6460-6b25-4e8d-9bd5-d4f030c3e3a7'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:22:01.639635 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f8b4a14f-99a3-410c-b591-1af05289de1d tempest-VolumesAdminNegativeTest-1913665487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:22:01.672659 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f8b4a14f-99a3-410c-b591-1af05289de1d tempest-VolumesAdminNegativeTest-1913665487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:22:01.706023 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-f8b4a14f-99a3-410c-b591-1af05289de1d tempest-VolumesAdminNegativeTest-1913665487 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:22:01.713609 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f8b4a14f-99a3-410c-b591-1af05289de1d tempest-VolumesAdminNegativeTest-1913665487 None] Deleted volume successfully. May 02 10:22:01.783759 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f8b4a14f-99a3-410c-b591-1af05289de1d tempest-VolumesAdminNegativeTest-1913665487 None] Lock "b'cinder-cae75812-17f0-4284-96d9-ee945957a3bc-delete_volume'" released by "delete_volume" :: held 5.194s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:22:05.273894 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.image_utils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph, size 616.00 MB, duration 18.54 sec {{(pid=123784) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} May 02 10:22:05.274560 ncdv-master-1 cinder-volume[123784]: INFO cinder.image.image_utils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Image download 616.00 MB at 33.23 MB/s May 02 10:22:05.312848 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:22:05.468910 ncdv-master-1 sudo[133704]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph May 02 10:22:05.469796 ncdv-master-1 sudo[133704]: pam_unix(sudo:session): session opened for user root by (uid=0) May 02 10:22:07.447817 ncdv-master-1 sudo[133704]: pam_unix(sudo:session): session closed for user root May 02 10:22:07.450834 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph" returned: 0 in 2.138s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:22:07.457440 ncdv-master-1 cinder-volume[123784]: WARNING py.warnings [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' May 02 10:22:07.457440 ncdv-master-1 cinder-volume[123784]: debtcollector.deprecate( May 02 10:22:07.457440 ncdv-master-1 cinder-volume[123784]: May 02 10:22:07.458686 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.image_utils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Temporary image afdfe80f-453b-40fc-ae29-550b735758e3 is fetched for user 26be0fc413e94efa9d98b869a834e69f. {{(pid=123784) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} May 02 10:22:07.686734 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:22:07.847224 ncdv-master-1 sudo[133722]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph May 02 10:22:07.848719 ncdv-master-1 sudo[133722]: pam_unix(sudo:session): session opened for user root by (uid=0) May 02 10:22:10.309007 ncdv-master-1 sudo[133722]: pam_unix(sudo:session): session closed for user root May 02 10:22:10.311210 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph" returned: 0 in 2.624s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:22:10.313103 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] creating volume 'volume-1cbc9d75-d395-469f-815a-9f92db5893d4' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:22:10.315575 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:22:10.970816 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:22:10.971139 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:22:11.209511 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Attempting download of afdfe80f-453b-40fc-ae29-550b735758e3 ((None, None)) to volume 1cbc9d75-d395-469f-815a-9f92db5893d4. {{(pid=123784) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} May 02 10:22:11.350077 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_afdfe80f-453b-40fc-ae29-550b735758e3_dtejv4qk {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:22:11.728301 ncdv-master-1 sudo[133765]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_afdfe80f-453b-40fc-ae29-550b735758e3_dtejv4qk May 02 10:22:11.732225 ncdv-master-1 sudo[133765]: pam_unix(sudo:session): session opened for user root by (uid=0) May 02 10:22:14.333301 ncdv-master-1 sudo[133765]: pam_unix(sudo:session): session closed for user root May 02 10:22:14.336675 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_afdfe80f-453b-40fc-ae29-550b735758e3_dtejv4qk" returned: 0 in 2.985s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:22:14.338961 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:22:14.475554 ncdv-master-1 sudo[133786]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph May 02 10:22:14.477155 ncdv-master-1 sudo[133786]: pam_unix(sudo:session): session opened for user root by (uid=0) May 02 10:22:16.895664 ncdv-master-1 sudo[133786]: pam_unix(sudo:session): session closed for user root May 02 10:22:16.898668 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph" returned: 0 in 2.559s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:22:16.900954 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.image_utils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] afdfe80f-453b-40fc-ae29-550b735758e3 was vhdx, converting to raw {{(pid=123784) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} May 02 10:22:16.902458 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp2057zvmn {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:22:16.948974 ncdv-master-1 sudo[133839]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp2057zvmn May 02 10:22:16.949789 ncdv-master-1 sudo[133839]: pam_unix(sudo:session): session opened for user root by (uid=0) May 02 10:22:17.284693 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-b9473373-828e-4206-b99a-7054a5f4ab8a req-ab937dd0-4de5-4568-bbaa-ff0e5fd2209c tempest-LiveAutoBlockMigrationV225Test-702811144 None] Terminate volume connection completed successfully. May 02 10:22:17.284693 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-b9473373-828e-4206-b99a-7054a5f4ab8a req-ab937dd0-4de5-4568-bbaa-ff0e5fd2209c tempest-LiveAutoBlockMigrationV225Test-702811144 None] Deleting attachment 92a3ce48-dd8e-4560-a4e9-3bac50aa9b2e. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:22:20.192899 ncdv-master-1 sudo[133839]: pam_unix(sudo:session): session closed for user root May 02 10:22:20.194699 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp2057zvmn" returned: 0 in 3.292s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:22:20.195680 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:22:20.289971 ncdv-master-1 sudo[133860]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph May 02 10:22:20.290764 ncdv-master-1 sudo[133860]: pam_unix(sudo:session): session opened for user root by (uid=0) May 02 10:22:21.395460 ncdv-master-1 sudo[133860]: pam_unix(sudo:session): session closed for user root May 02 10:22:21.397813 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph" returned: 0 in 1.202s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:22:21.398525 ncdv-master-1 cinder-volume[123784]: WARNING py.warnings [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' May 02 10:22:21.398525 ncdv-master-1 cinder-volume[123784]: debtcollector.deprecate( May 02 10:22:21.398525 ncdv-master-1 cinder-volume[123784]: May 02 10:22:21.399520 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.image_utils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_afdfe80f-453b-40fc-ae29-550b735758e3_lxs4cjx2ncdv-master-1@ceph, size 700.00 MB, duration 3.29 sec, destination /opt/stack/data/cinder/conversion/tmp2057zvmn {{(pid=123784) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} May 02 10:22:21.399898 ncdv-master-1 cinder-volume[123784]: INFO cinder.image.image_utils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Converted 700.00 MB image at 212.56 MB/s May 02 10:22:21.401473 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:22:21.880381 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:22:21.884308 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:22:22.070602 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] deleting rbd volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:22:25.776272 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp2057zvmn volume-1cbc9d75-d395-469f-815a-9f92db5893d4 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:22:30.330231 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-77baa703-e658-480f-9ef0-ec1d3a055c0e req-2a87436c-3705-469b-b527-e0fd34458bd2 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Terminate volume connection completed successfully. May 02 10:22:30.330231 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-77baa703-e658-480f-9ef0-ec1d3a055c0e req-2a87436c-3705-469b-b527-e0fd34458bd2 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Deleting attachment ed56cb50-e244-4685-8c4c-ca31c1e36cda. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:22:33.098446 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:22:33.158143 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Flow 'volume_create_manager' (47489fbf-0349-446d-b21e-acf2fb70f2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:22:33.176916 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2038c2-aa99-4b16-8a84-91c5543667e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:22:33.211250 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2038c2-aa99-4b16-8a84-91c5543667e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-975750790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d536f18d-9a9b-426b-a5a6-b941c78c7898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e3a228719d4cbda0507cba959f1816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:22:33Z,use_quota=True,user_id='662c15e746b84fdbb497d700c9288931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:22:33.229230 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1bc3cc-806d-441f-baa5-da81fc44ce23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:22:33.237180 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1bc3cc-806d-441f-baa5-da81fc44ce23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:22:33.248892 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec134c2-a078-4745-8d3d-875639bf473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:22:33.350914 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec134c2-a078-4745-8d3d-875639bf473d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd536f18d-9a9b-426b-a5a6-b941c78c7898', 'volume_name': 'volume-d536f18d-9a9b-426b-a5a6-b941c78c7898', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:22:33.372111 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3278e65f-b69a-424b-b5c0-4bbf494fc3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:22:33.379263 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3278e65f-b69a-424b-b5c0-4bbf494fc3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:22:33.386024 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d79064-6f54-4adc-a368-487b2941210a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:22:33.387492 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Volume d536f18d-9a9b-426b-a5a6-b941c78c7898: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d536f18d-9a9b-426b-a5a6-b941c78c7898', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:22:33.388371 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Cloning d536f18d-9a9b-426b-a5a6-b941c78c7898 from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:22:58.728781 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:22:58.729525 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:22:58.796781 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:22:58.926463 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:23:12.173478 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:23:12.188528 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Flow 'volume_create_manager' (dc77d84e-1eed-486e-a86d-5f5ce635d3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:23:12.195536 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7f3d38-c7ea-42c1-8804-6fa078a159f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:12.211202 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7f3d38-c7ea-42c1-8804-6fa078a159f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-263325756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1ae7bcde-af1c-4d21-ae86-0cc710bb2179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30fec6fdee4788af310ffa15c23ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:23:12Z,use_quota=True,user_id='17581b53723f42bdbe7dd12ea1f691cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:12.216683 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bab992-5d71-4217-be1f-4356c37314b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:12.221529 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bab992-5d71-4217-be1f-4356c37314b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:12.226859 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db66527d-685f-4073-b9de-51c9ee27c215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:12.231045 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db66527d-685f-4073-b9de-51c9ee27c215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ae7bcde-af1c-4d21-ae86-0cc710bb2179', 'volume_name': 'volume-1ae7bcde-af1c-4d21-ae86-0cc710bb2179', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:12.236049 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4fad12-c4f7-4126-9d50-96cb40d27696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:12.239928 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4fad12-c4f7-4126-9d50-96cb40d27696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:12.244662 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31707e5e-2144-4fbc-a760-3e03834af863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:12.245723 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Volume 1ae7bcde-af1c-4d21-ae86-0cc710bb2179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ae7bcde-af1c-4d21-ae86-0cc710bb2179', 'volume_size': 1} May 02 10:23:12.246129 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] creating volume 'volume-1ae7bcde-af1c-4d21-ae86-0cc710bb2179' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:23:12.246809 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:23:13.741033 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:23:13.742458 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:23:13.747241 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31707e5e-2144-4fbc-a760-3e03834af863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ae7bcde-af1c-4d21-ae86-0cc710bb2179', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:13.755265 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6819802-bcb8-40bc-a962-f2ddda96959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:13.834117 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Volume volume-1ae7bcde-af1c-4d21-ae86-0cc710bb2179 (1ae7bcde-af1c-4d21-ae86-0cc710bb2179): created successfully May 02 10:23:13.838939 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6819802-bcb8-40bc-a962-f2ddda96959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:13.846081 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Flow 'volume_create_manager' (dc77d84e-1eed-486e-a86d-5f5ce635d3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:23:13.937648 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-80d54797-160c-489e-aa51-1c1957579222 tempest-AttachSCSIVolumeTestJSON-54306563 None] Created volume successfully. May 02 10:23:15.972488 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-81ee402b-442c-4052-9f50-1ee5819a918f req-4e79f163-8e12-40f2-9f8a-fd295a86d750 tempest-AttachSCSIVolumeTestJSON-54306563 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:23:16.465342 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp2057zvmn volume-1cbc9d75-d395-469f-815a-9f92db5893d4 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 50.689s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:23:16.666115 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:23:17.015555 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-81ee402b-442c-4052-9f50-1ee5819a918f req-4e79f163-8e12-40f2-9f8a-fd295a86d750 tempest-AttachSCSIVolumeTestJSON-54306563 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.043s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:23:17.016325 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-81ee402b-442c-4052-9f50-1ee5819a918f req-4e79f163-8e12-40f2-9f8a-fd295a86d750 tempest-AttachSCSIVolumeTestJSON-54306563 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1ae7bcde-af1c-4d21-ae86-0cc710bb2179', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '1ae7bcde-af1c-4d21-ae86-0cc710bb2179', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:23:17.158399 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-81ee402b-442c-4052-9f50-1ee5819a918f req-4e79f163-8e12-40f2-9f8a-fd295a86d750 tempest-AttachSCSIVolumeTestJSON-54306563 None] Connection info returned from driver {'name': 'volumes/volume-1ae7bcde-af1c-4d21-ae86-0cc710bb2179', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1ae7bcde-af1c-4d21-ae86-0cc710bb2179', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3f91e5d7-4fb8-4aca-b211-8b7aeacf6135'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:23:17.303222 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-81ee402b-442c-4052-9f50-1ee5819a918f req-4e79f163-8e12-40f2-9f8a-fd295a86d750 tempest-AttachSCSIVolumeTestJSON-54306563 None] attachment_update completed successfully. May 02 10:23:17.910470 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:23:17.910944 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:23:17.911394 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Downloaded image afdfe80f-453b-40fc-ae29-550b735758e3 ((None, None)) to volume 1cbc9d75-d395-469f-815a-9f92db5893d4 successfully. {{(pid=123784) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1218}} May 02 10:23:17.992870 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.image_utils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Temporary image afdfe80f-453b-40fc-ae29-550b735758e3 for user 26be0fc413e94efa9d98b869a834e69f is deleted. {{(pid=123784) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} May 02 10:23:18.380568 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Created reservations ['60202b90-769c-47c3-bebb-fcc2d714e53d', '8b5b07f9-ce5b-46cd-8088-30315faa8a12', '157f1db8-0215-4201-a9c2-0b74b1aec63d', '3ce5119a-1a0e-44bc-98fd-b49d9ada0768'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:23:18.399057 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Creating image volume entry: {'cluster_name': None, 'deleted_at': None, 'deleted': False, 'replication_driver_data': None, 'previous_status': None, 'bootable': False, 'provider_id': None, 'launched_at': None, 'display_description': None, 'created_at': datetime.datetime(2022, 5, 2, 10, 21, 45, tzinfo=datetime.timezone.utc), 'replication_extended_status': None, 'encryption_key_id': None, 'scheduled_at': datetime.datetime(2022, 5, 2, 10, 21, 46, tzinfo=datetime.timezone.utc), 'size': 1, 'updated_at': datetime.datetime(2022, 5, 2, 10, 21, 46, tzinfo=datetime.timezone.utc), 'metadata': {}, 'terminated_at': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'ec2_id': None, 'multiattach': False, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'service_uuid': None, 'consistencygroup_id': None, 'volume_metadata': [], 'group_id': None, 'replication_status': None, 'provider_geometry': None, 'user_id': '26be0fc413e94efa9d98b869a834e69f', 'provider_auth': None, 'shared_targets': True, 'availability_zone': 'nova', 'volume_type_id': '4511150c-727c-4433-9645-06cd78957646', 'provider_location': None, 'volume_admin_metadata': [], 'display_name': 'image-afdfe80f-453b-40fc-ae29-550b735758e3', 'host': 'ncdv-master-1@ceph#ceph', 'attach_status': 'detached', 'status': 'creating', 'source_volid': '1cbc9d75-d395-469f-815a-9f92db5893d4'}. {{(pid=123784) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} May 02 10:23:18.687293 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Volume reschedule parameters: False retry: None {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:23:18.708130 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Flow 'volume_create_manager' (694530df-deb9-46b5-ae3c-440d77303a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:23:18.714970 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269093c1-efa5-431f-a672-8a43f84927ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:18.731109 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269093c1-efa5-431f-a672-8a43f84927ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='image-afdfe80f-453b-40fc-ae29-550b735758e3',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ba46b094-918c-4aa2-b6bc-591c699050b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972cae0aa9694d6cad22fbdbcf916ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1cbc9d75-d395-469f-815a-9f92db5893d4,status='creating',terminated_at=None,updated_at=2022-05-02T10:21:46Z,use_quota=True,user_id='26be0fc413e94efa9d98b869a834e69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:18.736661 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a97e8ed-88c8-43ad-bddd-b58dbb2c2c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:18.740958 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a97e8ed-88c8-43ad-bddd-b58dbb2c2c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:18.746208 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f91776d-75aa-442a-a61d-2ff8e4bf8677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:18.761931 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f91776d-75aa-442a-a61d-2ff8e4bf8677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'volume_name': 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1', 'volume_size': 1, 'source_volid': '1cbc9d75-d395-469f-815a-9f92db5893d4', 'source_volstatus': 'downloading'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:18.767731 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22ae718-7d4d-42b3-889f-97ceb4855145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:18.773025 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22ae718-7d4d-42b3-889f-97ceb4855145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:18.776980 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3683cf2a-ff13-419e-9262-6e14f5a4bfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:18.778145 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Volume ba46b094-918c-4aa2-b6bc-591c699050b1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1', 'volume_size': 1, 'source_volid': '1cbc9d75-d395-469f-815a-9f92db5893d4', 'source_volstatus': 'downloading'} May 02 10:23:18.790670 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:23:19.004990 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] creating snapshot='volume-ba46b094-918c-4aa2-b6bc-591c699050b1.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:23:20.647383 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] cloning 'volume-1cbc9d75-d395-469f-815a-9f92db5893d4@volume-ba46b094-918c-4aa2-b6bc-591c699050b1.clone_snap' to 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:23:21.525368 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-4755b61e-e880-4a7b-b345-cac6e9ae806b req-c360eac8-4ce8-4662-b8f1-f9e0c2450691 tempest-AttachSCSIVolumeTestJSON-54306563 None] Terminate volume connection completed successfully. May 02 10:23:21.526097 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-4755b61e-e880-4a7b-b345-cac6e9ae806b req-c360eac8-4ce8-4662-b8f1-f9e0c2450691 tempest-AttachSCSIVolumeTestJSON-54306563 None] Deleting attachment 3f91e5d7-4fb8-4aca-b211-8b7aeacf6135. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:23:22.184770 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:23:22.185947 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:23:22.187212 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:23:22.704493 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:23:22.708566 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3683cf2a-ff13-419e-9262-6e14f5a4bfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1', 'volume_size': 1, 'source_volid': '1cbc9d75-d395-469f-815a-9f92db5893d4', 'source_volstatus': 'downloading'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:22.714062 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d55025-38e6-4ae2-9812-997ece488717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:22.842606 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Volume volume-ba46b094-918c-4aa2-b6bc-591c699050b1 (ba46b094-918c-4aa2-b6bc-591c699050b1): created successfully May 02 10:23:22.846531 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d55025-38e6-4ae2-9812-997ece488717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:22.852204 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Flow 'volume_create_manager' (694530df-deb9-46b5-ae3c-440d77303a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:23:22.929210 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Created volume successfully. May 02 10:23:23.134966 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Creating new image-volume cache entry for image afdfe80f-453b-40fc-ae29-550b735758e3 on ncdv-master-1@ceph#ceph {{(pid=123784) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} May 02 10:23:23.215754 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] New image-volume cache entry created: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 23, 23, 143061)}. {{(pid=123784) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} May 02 10:23:23.224475 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 96.520s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:23:23.224475 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Marking volume 1cbc9d75-d395-469f-815a-9f92db5893d4 as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:23:23.350895 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 1cbc9d75-d395-469f-815a-9f92db5893d4. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:23:23.358797 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Creating volume glance metadata for volume 1cbc9d75-d395-469f-815a-9f92db5893d4 backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:23:23.644093 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af8a20c-fdc0-45d4-a3b2-2e7731d8b9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cbc9d75-d395-469f-815a-9f92db5893d4', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:23.649056 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb71bf5-738c-4148-b33a-83941f386bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:23.723401 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4 (1cbc9d75-d395-469f-815a-9f92db5893d4): created successfully May 02 10:23:23.727223 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb71bf5-738c-4148-b33a-83941f386bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:23.742515 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Flow 'volume_create_manager' (010c6df4-9e64-4b87-88b2-419b242fe1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:23:23.761643 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 50.372s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:23:23.837258 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5076b7c8-84b7-4906-9ff7-f772b3665a98 tempest-ServersTestBootFromVolume-712353293 None] Created volume successfully. May 02 10:23:23.858686 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 23, 23, 766972)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:23:23.858686 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:23:23.858686 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:23:23.858686 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.092s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:23:23.859028 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:23:23.869248 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 23, 23, 866748)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:23:23.869831 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:23:23.870433 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:23:23.894818 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:23:24.062437 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] creating snapshot='volume-d536f18d-9a9b-426b-a5a6-b941c78c7898.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:23:25.889165 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-d536f18d-9a9b-426b-a5a6-b941c78c7898.clone_snap' to 'volume-d536f18d-9a9b-426b-a5a6-b941c78c7898' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:23:27.251660 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:23:27.256738 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:23:27.257268 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:23:27.826816 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:23:27.828047 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Marking volume d536f18d-9a9b-426b-a5a6-b941c78c7898 as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:23:27.925237 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to d536f18d-9a9b-426b-a5a6-b941c78c7898. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:23:27.925703 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Creating volume glance metadata for volume d536f18d-9a9b-426b-a5a6-b941c78c7898 backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:23:28.111637 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d79064-6f54-4adc-a368-487b2941210a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d536f18d-9a9b-426b-a5a6-b941c78c7898', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:28.119651 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e54e73-83bb-47a0-b719-67e5fb98c767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:28.263575 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Volume volume-d536f18d-9a9b-426b-a5a6-b941c78c7898 (d536f18d-9a9b-426b-a5a6-b941c78c7898): created successfully May 02 10:23:28.267364 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e54e73-83bb-47a0-b719-67e5fb98c767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:28.281396 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Flow 'volume_create_manager' (47489fbf-0349-446d-b21e-acf2fb70f2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:23:28.386217 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-c2ebb4a4-13d3-41fc-b996-3c8cf22f31cd tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Created volume successfully. May 02 10:23:29.326913 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-881f97cb-d38d-4f0c-acff-15a94d62aad0 req-88544e6a-4f2b-471a-87ec-1063d543c890 tempest-ServersTestBootFromVolume-712353293 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:23:30.249585 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-881f97cb-d38d-4f0c-acff-15a94d62aad0 req-88544e6a-4f2b-471a-87ec-1063d543c890 tempest-ServersTestBootFromVolume-712353293 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.922s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:23:30.250518 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-881f97cb-d38d-4f0c-acff-15a94d62aad0 req-88544e6a-4f2b-471a-87ec-1063d543c890 tempest-ServersTestBootFromVolume-712353293 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1cbc9d75-d395-469f-815a-9f92db5893d4', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '1cbc9d75-d395-469f-815a-9f92db5893d4', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:23:30.391944 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-881f97cb-d38d-4f0c-acff-15a94d62aad0 req-88544e6a-4f2b-471a-87ec-1063d543c890 tempest-ServersTestBootFromVolume-712353293 None] Connection info returned from driver {'name': 'volumes/volume-1cbc9d75-d395-469f-815a-9f92db5893d4', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1cbc9d75-d395-469f-815a-9f92db5893d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '727d6bd5-9fe5-4c5f-90b4-63bf76701be9'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:23:30.564050 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-881f97cb-d38d-4f0c-acff-15a94d62aad0 req-88544e6a-4f2b-471a-87ec-1063d543c890 tempest-ServersTestBootFromVolume-712353293 None] attachment_update completed successfully. May 02 10:23:34.755514 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-7782910a-1ba2-418f-9f36-a933a6788862 req-c19fd0d3-854a-460c-a76e-c86568af6b83 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:23:35.272954 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:23:35.349733 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Flow 'volume_create_manager' (331649ef-ed61-4c4a-b22f-ee998d2d8db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:23:35.357853 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f5f1d3-fa0f-43f0-97ef-c5e22a38c944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:35.376571 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f5f1d3-fa0f-43f0-97ef-c5e22a38c944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-898009325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a7d9fd1b-667e-4d1e-8a82-37e3314f37a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2130a8035040089eef66d1efbf65df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:23:35Z,use_quota=True,user_id='1ea3eddf81624b41a4410ea85e17eabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:35.382767 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa504a92-2a99-489a-a285-e6ceccdabb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:35.387780 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa504a92-2a99-489a-a285-e6ceccdabb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:35.394306 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5607b65-32d7-4a28-aceb-484a8b6548f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:35.398828 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5607b65-32d7-4a28-aceb-484a8b6548f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d9fd1b-667e-4d1e-8a82-37e3314f37a1', 'volume_name': 'volume-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:35.413847 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394fafa5-32b0-46bf-ba45-3330fde33977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:35.422676 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394fafa5-32b0-46bf-ba45-3330fde33977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:35.424074 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19ec9c9-a6d7-4f2d-9884-e1809815357d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:35.425495 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Volume a7d9fd1b-667e-4d1e-8a82-37e3314f37a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1', 'volume_size': 1} May 02 10:23:35.426072 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] creating volume 'volume-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:23:35.427666 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:23:35.830895 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-dab4e3b1-4412-4197-9171-bf38c348e1b2 tempest-AttachSCSIVolumeTestJSON-54306563 None] Lock "b'cinder-1ae7bcde-af1c-4d21-ae86-0cc710bb2179-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:23:35.934179 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-7782910a-1ba2-418f-9f36-a933a6788862 req-c19fd0d3-854a-460c-a76e-c86568af6b83 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.177s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:23:35.934179 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-7782910a-1ba2-418f-9f36-a933a6788862 req-c19fd0d3-854a-460c-a76e-c86568af6b83 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d536f18d-9a9b-426b-a5a6-b941c78c7898', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'd536f18d-9a9b-426b-a5a6-b941c78c7898', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:23:35.965253 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dab4e3b1-4412-4197-9171-bf38c348e1b2 tempest-AttachSCSIVolumeTestJSON-54306563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:23:36.256109 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dab4e3b1-4412-4197-9171-bf38c348e1b2 tempest-AttachSCSIVolumeTestJSON-54306563 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:23:36.256808 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dab4e3b1-4412-4197-9171-bf38c348e1b2 tempest-AttachSCSIVolumeTestJSON-54306563 None] Volume volume-1ae7bcde-af1c-4d21-ae86-0cc710bb2179 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:23:36.355086 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dab4e3b1-4412-4197-9171-bf38c348e1b2 tempest-AttachSCSIVolumeTestJSON-54306563 None] deleting rbd volume volume-1ae7bcde-af1c-4d21-ae86-0cc710bb2179 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:23:36.358768 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-7782910a-1ba2-418f-9f36-a933a6788862 req-c19fd0d3-854a-460c-a76e-c86568af6b83 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Connection info returned from driver {'name': 'volumes/volume-d536f18d-9a9b-426b-a5a6-b941c78c7898', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd536f18d-9a9b-426b-a5a6-b941c78c7898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd9d83989-06e2-45a9-948e-34cccc9d5651'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:23:36.413988 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:23:36.414556 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:23:36.419290 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19ec9c9-a6d7-4f2d-9884-e1809815357d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:36.425217 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5f8844-c3a0-4ade-98ec-8af6b5833aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:23:36.535864 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-7782910a-1ba2-418f-9f36-a933a6788862 req-c19fd0d3-854a-460c-a76e-c86568af6b83 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] attachment_update completed successfully. May 02 10:23:36.548456 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Volume volume-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1 (a7d9fd1b-667e-4d1e-8a82-37e3314f37a1): created successfully May 02 10:23:36.556822 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5f8844-c3a0-4ade-98ec-8af6b5833aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:23:36.565433 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Flow 'volume_create_manager' (331649ef-ed61-4c4a-b22f-ee998d2d8db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:23:36.695388 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-67a07b07-ba64-40b4-a804-c1df746e1e99 tempest-LiveMigrationTest-1883862344 None] Created volume successfully. May 02 10:23:38.940202 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-42a2e321-c6b1-47f1-96e6-e56fcaa71d4a req-aa4342b3-987d-4695-808a-75db29ab1f2d tempest-LiveMigrationTest-1883862344 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:23:39.825934 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-42a2e321-c6b1-47f1-96e6-e56fcaa71d4a req-aa4342b3-987d-4695-808a-75db29ab1f2d tempest-LiveMigrationTest-1883862344 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.885s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:23:39.826672 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-42a2e321-c6b1-47f1-96e6-e56fcaa71d4a req-aa4342b3-987d-4695-808a-75db29ab1f2d tempest-LiveMigrationTest-1883862344 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'a7d9fd1b-667e-4d1e-8a82-37e3314f37a1', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:23:39.953922 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-42a2e321-c6b1-47f1-96e6-e56fcaa71d4a req-aa4342b3-987d-4695-808a-75db29ab1f2d tempest-LiveMigrationTest-1883862344 None] Connection info returned from driver {'name': 'volumes/volume-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a7d9fd1b-667e-4d1e-8a82-37e3314f37a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '49a51205-debc-4249-9d15-7371c417230b'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:23:40.084749 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-42a2e321-c6b1-47f1-96e6-e56fcaa71d4a req-aa4342b3-987d-4695-808a-75db29ab1f2d tempest-LiveMigrationTest-1883862344 None] attachment_update completed successfully. May 02 10:23:40.941678 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-dab4e3b1-4412-4197-9171-bf38c348e1b2 tempest-AttachSCSIVolumeTestJSON-54306563 None] Created reservations ['7b745a42-f4dc-4bbf-a1ec-4df0e458cd7e', '8ae3333b-45ce-49e2-93fd-ff0920d89fb9', 'd15b53f1-be43-43cf-a7ed-68929c8b9733', '1c561d95-5a4b-4959-96fe-196f7ab074f8'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:23:41.186330 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dab4e3b1-4412-4197-9171-bf38c348e1b2 tempest-AttachSCSIVolumeTestJSON-54306563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:23:41.296742 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dab4e3b1-4412-4197-9171-bf38c348e1b2 tempest-AttachSCSIVolumeTestJSON-54306563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:23:41.393916 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-dab4e3b1-4412-4197-9171-bf38c348e1b2 tempest-AttachSCSIVolumeTestJSON-54306563 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:23:41.402298 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-dab4e3b1-4412-4197-9171-bf38c348e1b2 tempest-AttachSCSIVolumeTestJSON-54306563 None] Deleted volume successfully. May 02 10:23:41.503515 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-dab4e3b1-4412-4197-9171-bf38c348e1b2 tempest-AttachSCSIVolumeTestJSON-54306563 None] Lock "b'cinder-1ae7bcde-af1c-4d21-ae86-0cc710bb2179-delete_volume'" released by "delete_volume" :: held 5.672s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:23:55.229142 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-ed4c7c1f-37ed-46a0-b071-302f83d5c69d req-cdf88e7c-0d26-483a-b46d-e1bbc6bba6d2 tempest-LiveMigrationTest-186543981 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:23:56.132124 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-ed4c7c1f-37ed-46a0-b071-302f83d5c69d req-cdf88e7c-0d26-483a-b46d-e1bbc6bba6d2 tempest-LiveMigrationTest-186543981 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.903s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:23:56.133036 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-ed4c7c1f-37ed-46a0-b071-302f83d5c69d req-cdf88e7c-0d26-483a-b46d-e1bbc6bba6d2 tempest-LiveMigrationTest-186543981 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'a7d9fd1b-667e-4d1e-8a82-37e3314f37a1', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:23:56.220859 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-ed4c7c1f-37ed-46a0-b071-302f83d5c69d req-cdf88e7c-0d26-483a-b46d-e1bbc6bba6d2 tempest-LiveMigrationTest-186543981 None] Connection info returned from driver {'name': 'volumes/volume-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a7d9fd1b-667e-4d1e-8a82-37e3314f37a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c591ab4a-669f-4209-b19b-001d33fdaeed'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:23:56.350029 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-ed4c7c1f-37ed-46a0-b071-302f83d5c69d req-cdf88e7c-0d26-483a-b46d-e1bbc6bba6d2 tempest-LiveMigrationTest-186543981 None] attachment_update completed successfully. May 02 10:23:58.733194 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:23:58.739252 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:23:58.858330 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:23:58.911313 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:24:07.858108 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-ed4c7c1f-37ed-46a0-b071-302f83d5c69d req-22cb465f-adb3-49de-afe3-b92aee811f90 tempest-LiveMigrationTest-186543981 None] Terminate volume connection completed successfully. May 02 10:24:07.859356 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-ed4c7c1f-37ed-46a0-b071-302f83d5c69d req-22cb465f-adb3-49de-afe3-b92aee811f90 tempest-LiveMigrationTest-186543981 None] Deleting attachment 49a51205-debc-4249-9d15-7371c417230b. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:24:13.459508 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-d95ad831-7dc0-4568-964f-0a304c05c0cc req-0b8eb7f0-6535-4d4f-827f-6fc65f1b04e1 tempest-LiveMigrationTest-1883862344 None] Terminate volume connection completed successfully. May 02 10:24:13.460132 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-d95ad831-7dc0-4568-964f-0a304c05c0cc req-0b8eb7f0-6535-4d4f-827f-6fc65f1b04e1 tempest-LiveMigrationTest-1883862344 None] Deleting attachment c591ab4a-669f-4209-b19b-001d33fdaeed. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:24:15.255269 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-f1650705-29d0-42c7-b3c5-182376ca9c98 req-3f9295cb-cf27-4f76-a5a0-36e5526df66c tempest-LiveAutoBlockMigrationV225Test-702811144 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:24:16.016237 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-f1650705-29d0-42c7-b3c5-182376ca9c98 req-3f9295cb-cf27-4f76-a5a0-36e5526df66c tempest-LiveAutoBlockMigrationV225Test-702811144 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.760s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:24:16.019688 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-f1650705-29d0-42c7-b3c5-182376ca9c98 req-3f9295cb-cf27-4f76-a5a0-36e5526df66c tempest-LiveAutoBlockMigrationV225Test-702811144 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d536f18d-9a9b-426b-a5a6-b941c78c7898', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'd536f18d-9a9b-426b-a5a6-b941c78c7898', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:24:16.134561 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-f1650705-29d0-42c7-b3c5-182376ca9c98 req-3f9295cb-cf27-4f76-a5a0-36e5526df66c tempest-LiveAutoBlockMigrationV225Test-702811144 None] Connection info returned from driver {'name': 'volumes/volume-d536f18d-9a9b-426b-a5a6-b941c78c7898', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd536f18d-9a9b-426b-a5a6-b941c78c7898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'addbf535-01a4-4bd7-b779-19e3bf287330'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:24:16.303986 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:24:16.327193 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Flow 'volume_create_manager' (12662131-9032-4025-949d-7fa18376aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:24:16.334018 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128ee602-cc89-4939-839a-46ce3f48fbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:24:16.355755 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128ee602-cc89-4939-839a-46ce3f48fbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-574395090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7335928e-84f6-4e14-b1b9-916df7f6e5fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2130a8035040089eef66d1efbf65df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:24:16Z,use_quota=True,user_id='1ea3eddf81624b41a4410ea85e17eabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:24:16.362349 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee7b445-565b-4537-b942-0618eae1c6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:24:16.366867 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee7b445-565b-4537-b942-0618eae1c6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:24:16.372066 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c8b8b2-9eb2-4d28-b7fe-f435443d5977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:24:16.383231 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-f1650705-29d0-42c7-b3c5-182376ca9c98 req-3f9295cb-cf27-4f76-a5a0-36e5526df66c tempest-LiveAutoBlockMigrationV225Test-702811144 None] attachment_update completed successfully. May 02 10:24:16.459913 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c8b8b2-9eb2-4d28-b7fe-f435443d5977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7335928e-84f6-4e14-b1b9-916df7f6e5fc', 'volume_name': 'volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:24:16.465503 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051f9bba-7361-4749-bc81-cf272d82be0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:24:16.469763 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051f9bba-7361-4749-bc81-cf272d82be0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:24:16.474733 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c156e2-c567-488a-87e4-ab9797ecd7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:24:16.478220 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Volume 7335928e-84f6-4e14-b1b9-916df7f6e5fc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:24:16.478220 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Cloning 7335928e-84f6-4e14-b1b9-916df7f6e5fc from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:24:16.487657 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:24:16.582486 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 24, 16, 491516)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:24:16.583732 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:24:16.584676 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:24:16.591102 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.103s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:24:16.593656 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:24:16.667285 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 24, 16, 598098)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:24:16.667722 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:24:16.668134 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:24:16.683517 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:24:17.192888 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] creating snapshot='volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:24:20.366019 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc.clone_snap' to 'volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:24:23.694450 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:24:23.696396 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:24:23.697036 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:24:24.811886 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:24:24.812699 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Marking volume 7335928e-84f6-4e14-b1b9-916df7f6e5fc as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:24:24.926875 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 7335928e-84f6-4e14-b1b9-916df7f6e5fc. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:24:24.927245 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Creating volume glance metadata for volume 7335928e-84f6-4e14-b1b9-916df7f6e5fc backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:24:25.203392 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c156e2-c567-488a-87e4-ab9797ecd7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:24:25.222556 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87bd4fd-583c-4b5a-a0bd-eb611dbdd5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:24:25.341963 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Volume volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc (7335928e-84f6-4e14-b1b9-916df7f6e5fc): created successfully May 02 10:24:25.345695 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87bd4fd-583c-4b5a-a0bd-eb611dbdd5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:24:25.351850 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Flow 'volume_create_manager' (12662131-9032-4025-949d-7fa18376aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:24:25.466219 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f3c9c01c-8fda-40e0-bf1f-008e381b04cd tempest-LiveMigrationTest-1883862344 None] Created volume successfully. May 02 10:24:27.077996 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-f1650705-29d0-42c7-b3c5-182376ca9c98 req-c5063a26-4ddd-4453-8299-da43b9402252 tempest-LiveAutoBlockMigrationV225Test-702811144 None] Terminate volume connection completed successfully. May 02 10:24:27.080434 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-f1650705-29d0-42c7-b3c5-182376ca9c98 req-c5063a26-4ddd-4453-8299-da43b9402252 tempest-LiveAutoBlockMigrationV225Test-702811144 None] Deleting attachment d9d83989-06e2-45a9-948e-34cccc9d5651. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:24:30.786074 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-99fe9179-cf46-4c48-9880-1b29fd86a46c req-757a209a-2987-48e3-9fc8-9cfc5f6c4154 tempest-LiveMigrationTest-1883862344 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:24:31.765453 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-99fe9179-cf46-4c48-9880-1b29fd86a46c req-757a209a-2987-48e3-9fc8-9cfc5f6c4154 tempest-LiveMigrationTest-1883862344 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.979s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:24:31.766280 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-99fe9179-cf46-4c48-9880-1b29fd86a46c req-757a209a-2987-48e3-9fc8-9cfc5f6c4154 tempest-LiveMigrationTest-1883862344 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '7335928e-84f6-4e14-b1b9-916df7f6e5fc', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:24:31.932973 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-99fe9179-cf46-4c48-9880-1b29fd86a46c req-757a209a-2987-48e3-9fc8-9cfc5f6c4154 tempest-LiveMigrationTest-1883862344 None] Connection info returned from driver {'name': 'volumes/volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7335928e-84f6-4e14-b1b9-916df7f6e5fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '94b5f986-1fe4-4ef4-9e16-3872063ad56b'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:24:32.131753 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-99fe9179-cf46-4c48-9880-1b29fd86a46c req-757a209a-2987-48e3-9fc8-9cfc5f6c4154 tempest-LiveMigrationTest-1883862344 None] attachment_update completed successfully. May 02 10:24:37.933493 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-5882d764-ff57-4fa9-beac-72b584e8234a req-dcc38d0e-2359-45dd-9299-10d68f4a4e7c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Terminate volume connection completed successfully. May 02 10:24:37.934698 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-5882d764-ff57-4fa9-beac-72b584e8234a req-dcc38d0e-2359-45dd-9299-10d68f4a4e7c tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Deleting attachment addbf535-01a4-4bd7-b779-19e3bf287330. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:24:38.506471 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-5882d764-ff57-4fa9-beac-72b584e8234a req-b16183ed-a206-4f85-a1ae-a29ade1364b9 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Lock "b'cinder-d536f18d-9a9b-426b-a5a6-b941c78c7898-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:24:38.660071 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-5882d764-ff57-4fa9-beac-72b584e8234a req-b16183ed-a206-4f85-a1ae-a29ade1364b9 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:24:38.952877 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-5882d764-ff57-4fa9-beac-72b584e8234a req-b16183ed-a206-4f85-a1ae-a29ade1364b9 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:24:39.305312 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-5882d764-ff57-4fa9-beac-72b584e8234a req-b16183ed-a206-4f85-a1ae-a29ade1364b9 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] deleting rbd volume volume-d536f18d-9a9b-426b-a5a6-b941c78c7898 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:24:39.852840 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-127e40f8-2a63-4b08-aa9a-61557d759971 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Lock "b'cinder-413b81a5-a091-4d1b-837b-360ca175efea-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:24:40.146626 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-127e40f8-2a63-4b08-aa9a-61557d759971 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:24:41.047510 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-127e40f8-2a63-4b08-aa9a-61557d759971 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:24:41.048349 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-127e40f8-2a63-4b08-aa9a-61557d759971 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Volume volume-413b81a5-a091-4d1b-837b-360ca175efea is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:24:41.391630 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-127e40f8-2a63-4b08-aa9a-61557d759971 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] deleting rbd volume volume-413b81a5-a091-4d1b-837b-360ca175efea {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:24:41.488674 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:24:41.535279 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Flow 'volume_create_manager' (5f2b8927-8044-41e3-a39b-d6ee0f7cad23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:24:41.553185 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2939b136-16ac-4833-8870-b08cd3900369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:24:41.567703 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2939b136-16ac-4833-8870-b08cd3900369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1526387807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e1d06a54-376e-4770-a878-46b92d0cd536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c5102fde294e5fb3dbf22336934db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:24:40Z,use_quota=True,user_id='1cf4f9c1eeb94bff96fa42d2f20d805f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:24:41.574490 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d148ee-547b-4d1b-888f-66c37960891d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:24:41.580293 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d148ee-547b-4d1b-888f-66c37960891d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:24:41.586451 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bee7d11-3f1a-4a94-9e91-8899d649d33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:24:41.595257 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bee7d11-3f1a-4a94-9e91-8899d649d33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d06a54-376e-4770-a878-46b92d0cd536', 'volume_name': 'volume-e1d06a54-376e-4770-a878-46b92d0cd536', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:24:41.602209 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d48d5b4-d652-4656-9608-61770da0e351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:24:41.606690 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d48d5b4-d652-4656-9608-61770da0e351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:24:41.612274 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999b4d76-f8d3-425c-8f6a-1c8cb780915c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:24:41.613671 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Volume e1d06a54-376e-4770-a878-46b92d0cd536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d06a54-376e-4770-a878-46b92d0cd536', 'volume_size': 1} May 02 10:24:41.614358 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] creating volume 'volume-e1d06a54-376e-4770-a878-46b92d0cd536' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:24:41.615729 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:24:42.953580 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:24:42.953580 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:24:42.953580 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999b4d76-f8d3-425c-8f6a-1c8cb780915c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d06a54-376e-4770-a878-46b92d0cd536', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:24:42.963102 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68428f55-1849-4b3e-b1d3-7fb9e16e68fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:24:43.062345 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Volume volume-e1d06a54-376e-4770-a878-46b92d0cd536 (e1d06a54-376e-4770-a878-46b92d0cd536): created successfully May 02 10:24:43.070936 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68428f55-1849-4b3e-b1d3-7fb9e16e68fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:24:43.078717 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Flow 'volume_create_manager' (5f2b8927-8044-41e3-a39b-d6ee0f7cad23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:24:43.222942 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-1102efd9-bdeb-461a-940a-daa5f4c79818 tempest-AttachVolumeNegativeTest-1449702691 None] Created volume successfully. May 02 10:24:45.508120 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-61dd696c-bf08-478a-93be-7cea6402dc73 req-f3f3f8e3-d215-4db7-ba79-ff4a3fe07c59 tempest-AttachVolumeNegativeTest-1449702691 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:24:46.662150 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-61dd696c-bf08-478a-93be-7cea6402dc73 req-f3f3f8e3-d215-4db7-ba79-ff4a3fe07c59 tempest-AttachVolumeNegativeTest-1449702691 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.153s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:24:46.667929 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-61dd696c-bf08-478a-93be-7cea6402dc73 req-f3f3f8e3-d215-4db7-ba79-ff4a3fe07c59 tempest-AttachVolumeNegativeTest-1449702691 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e1d06a54-376e-4770-a878-46b92d0cd536', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'e1d06a54-376e-4770-a878-46b92d0cd536', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:24:46.779059 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-61dd696c-bf08-478a-93be-7cea6402dc73 req-f3f3f8e3-d215-4db7-ba79-ff4a3fe07c59 tempest-AttachVolumeNegativeTest-1449702691 None] Connection info returned from driver {'name': 'volumes/volume-e1d06a54-376e-4770-a878-46b92d0cd536', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e1d06a54-376e-4770-a878-46b92d0cd536', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b5fe9c95-4259-4d56-bb44-a45b093dc34c'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:24:46.947509 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-61dd696c-bf08-478a-93be-7cea6402dc73 req-f3f3f8e3-d215-4db7-ba79-ff4a3fe07c59 tempest-AttachVolumeNegativeTest-1449702691 None] attachment_update completed successfully. May 02 10:24:50.236558 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-5882d764-ff57-4fa9-beac-72b584e8234a req-b16183ed-a206-4f85-a1ae-a29ade1364b9 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:24:50.356989 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-5882d764-ff57-4fa9-beac-72b584e8234a req-b16183ed-a206-4f85-a1ae-a29ade1364b9 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] deleting parent snapshot volume-d536f18d-9a9b-426b-a5a6-b941c78c7898.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:24:54.050142 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-127e40f8-2a63-4b08-aa9a-61557d759971 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Created reservations ['3f8657c2-f3d9-4052-9612-473557f76c28', '5422eded-c17d-44d2-80d1-3e5cc94b95eb', '93f6425b-fe8a-4eb3-9108-11ffcf790855', '085e2e3a-3dc8-4644-b135-a0d3777494c4'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:24:54.160911 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [req-5882d764-ff57-4fa9-beac-72b584e8234a req-b16183ed-a206-4f85-a1ae-a29ade1364b9 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Created reservations ['3c89ac16-2676-46da-8d2f-c7867a588df8', '9df16f38-5ea3-4b3c-973d-fb66b09d5566', '0507b46c-727b-4780-a43b-bd65d7bb6849', 'a3184bdf-fd17-4f93-9c2f-feabca51c31c'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:24:54.327702 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-127e40f8-2a63-4b08-aa9a-61557d759971 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:24:54.391616 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-127e40f8-2a63-4b08-aa9a-61557d759971 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:24:54.444307 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-127e40f8-2a63-4b08-aa9a-61557d759971 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:24:54.457768 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-127e40f8-2a63-4b08-aa9a-61557d759971 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Deleted volume successfully. May 02 10:24:54.602282 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-127e40f8-2a63-4b08-aa9a-61557d759971 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Lock "b'cinder-413b81a5-a091-4d1b-837b-360ca175efea-delete_volume'" released by "delete_volume" :: held 14.749s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:24:54.647168 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-5882d764-ff57-4fa9-beac-72b584e8234a req-b16183ed-a206-4f85-a1ae-a29ade1364b9 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:24:54.777818 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-5882d764-ff57-4fa9-beac-72b584e8234a req-b16183ed-a206-4f85-a1ae-a29ade1364b9 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:24:54.825694 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [req-5882d764-ff57-4fa9-beac-72b584e8234a req-b16183ed-a206-4f85-a1ae-a29ade1364b9 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:24:54.830009 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-5882d764-ff57-4fa9-beac-72b584e8234a req-b16183ed-a206-4f85-a1ae-a29ade1364b9 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Deleted volume successfully. May 02 10:24:54.969485 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-5882d764-ff57-4fa9-beac-72b584e8234a req-b16183ed-a206-4f85-a1ae-a29ade1364b9 tempest-LiveAutoBlockMigrationV225Test-1453012592 None] Lock "b'cinder-d536f18d-9a9b-426b-a5a6-b941c78c7898-delete_volume'" released by "delete_volume" :: held 16.463s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:24:56.538407 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-a615d0ba-271f-47fc-bf97-f0d81c78f9b0 req-72ec49e5-c2af-461b-93de-f65c42ef0825 tempest-LiveMigrationTest-186543981 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:24:57.263702 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-a615d0ba-271f-47fc-bf97-f0d81c78f9b0 req-72ec49e5-c2af-461b-93de-f65c42ef0825 tempest-LiveMigrationTest-186543981 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.725s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:24:57.264682 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-a615d0ba-271f-47fc-bf97-f0d81c78f9b0 req-72ec49e5-c2af-461b-93de-f65c42ef0825 tempest-LiveMigrationTest-186543981 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '7335928e-84f6-4e14-b1b9-916df7f6e5fc', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:24:57.372426 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-a615d0ba-271f-47fc-bf97-f0d81c78f9b0 req-72ec49e5-c2af-461b-93de-f65c42ef0825 tempest-LiveMigrationTest-186543981 None] Connection info returned from driver {'name': 'volumes/volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7335928e-84f6-4e14-b1b9-916df7f6e5fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '59c846bc-819e-4e8e-9670-78e0cf29344b'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:24:57.508534 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-a615d0ba-271f-47fc-bf97-f0d81c78f9b0 req-72ec49e5-c2af-461b-93de-f65c42ef0825 tempest-LiveMigrationTest-186543981 None] attachment_update completed successfully. May 02 10:24:58.737776 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:24:58.740214 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:24:58.907340 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:24:59.087760 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:25:07.176016 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-a615d0ba-271f-47fc-bf97-f0d81c78f9b0 req-a6f5454b-6a0e-49ba-b66c-fad08ad53f59 tempest-LiveMigrationTest-186543981 None] Terminate volume connection completed successfully. May 02 10:25:07.176731 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-a615d0ba-271f-47fc-bf97-f0d81c78f9b0 req-a6f5454b-6a0e-49ba-b66c-fad08ad53f59 tempest-LiveMigrationTest-186543981 None] Deleting attachment 94b5f986-1fe4-4ef4-9e16-3872063ad56b. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:25:16.132476 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-a2fcb3cf-b03a-4f8f-a585-6a7553d7d1e7 tempest-LiveMigrationTest-1883862344 None] Terminate volume connection completed successfully. May 02 10:25:16.133124 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-a2fcb3cf-b03a-4f8f-a585-6a7553d7d1e7 tempest-LiveMigrationTest-1883862344 None] Deleting attachment 59c846bc-819e-4e8e-9670-78e0cf29344b. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:25:16.646625 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-2593ed11-044e-44b9-8e0e-a36fda62ede8 tempest-LiveMigrationTest-1883862344 None] Lock "b'cinder-7335928e-84f6-4e14-b1b9-916df7f6e5fc-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:25:16.818540 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-2593ed11-044e-44b9-8e0e-a36fda62ede8 tempest-LiveMigrationTest-1883862344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:25:17.141429 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-2593ed11-044e-44b9-8e0e-a36fda62ede8 tempest-LiveMigrationTest-1883862344 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:25:17.276225 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-2593ed11-044e-44b9-8e0e-a36fda62ede8 tempest-LiveMigrationTest-1883862344 None] deleting rbd volume volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:25:18.104485 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-e892bb9b-0ef1-429d-b859-4349d4ca3364 tempest-LiveMigrationTest-1883862344 None] Lock "b'cinder-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:25:18.237557 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e892bb9b-0ef1-429d-b859-4349d4ca3364 tempest-LiveMigrationTest-1883862344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:25:18.428518 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e892bb9b-0ef1-429d-b859-4349d4ca3364 tempest-LiveMigrationTest-1883862344 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:25:18.429336 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e892bb9b-0ef1-429d-b859-4349d4ca3364 tempest-LiveMigrationTest-1883862344 None] Volume volume-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:25:18.671204 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e892bb9b-0ef1-429d-b859-4349d4ca3364 tempest-LiveMigrationTest-1883862344 None] deleting rbd volume volume-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:25:26.756927 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-2593ed11-044e-44b9-8e0e-a36fda62ede8 tempest-LiveMigrationTest-1883862344 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:25:27.105137 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-2593ed11-044e-44b9-8e0e-a36fda62ede8 tempest-LiveMigrationTest-1883862344 None] deleting parent snapshot volume-7335928e-84f6-4e14-b1b9-916df7f6e5fc.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:25:31.679827 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-2593ed11-044e-44b9-8e0e-a36fda62ede8 tempest-LiveMigrationTest-1883862344 None] Created reservations ['b5e84f76-ddfb-4ac6-ba00-4440ca9f25ba', '18b39bf6-51d5-42c5-8669-b14e63a473e4', 'dfd843a8-3462-42a4-b79f-af20dcf29463', 'c8bc21e4-6bc7-4744-a4c5-b054ef5dfc2a'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:25:31.914548 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-e892bb9b-0ef1-429d-b859-4349d4ca3364 tempest-LiveMigrationTest-1883862344 None] Created reservations ['bee9b5d1-1069-4b65-941c-ea96edd82355', '6faad217-c182-4af3-84bb-fd2bc3f61210', 'a177825e-7f55-4db8-8cc9-cbb8156ece5b', 'aa5bebf6-3721-4168-9f11-d8dab724f719'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:25:32.102788 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-2593ed11-044e-44b9-8e0e-a36fda62ede8 tempest-LiveMigrationTest-1883862344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:25:32.143999 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-2593ed11-044e-44b9-8e0e-a36fda62ede8 tempest-LiveMigrationTest-1883862344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:25:32.205609 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-2593ed11-044e-44b9-8e0e-a36fda62ede8 tempest-LiveMigrationTest-1883862344 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:25:32.233880 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-2593ed11-044e-44b9-8e0e-a36fda62ede8 tempest-LiveMigrationTest-1883862344 None] Deleted volume successfully. May 02 10:25:32.347159 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-efa60288-7c71-4f9d-ba64-033bcf2bb0ad req-2593ed11-044e-44b9-8e0e-a36fda62ede8 tempest-LiveMigrationTest-1883862344 None] Lock "b'cinder-7335928e-84f6-4e14-b1b9-916df7f6e5fc-delete_volume'" released by "delete_volume" :: held 15.700s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:25:32.387021 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e892bb9b-0ef1-429d-b859-4349d4ca3364 tempest-LiveMigrationTest-1883862344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:25:32.446380 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e892bb9b-0ef1-429d-b859-4349d4ca3364 tempest-LiveMigrationTest-1883862344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:25:32.507940 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-e892bb9b-0ef1-429d-b859-4349d4ca3364 tempest-LiveMigrationTest-1883862344 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:25:32.516130 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e892bb9b-0ef1-429d-b859-4349d4ca3364 tempest-LiveMigrationTest-1883862344 None] Deleted volume successfully. May 02 10:25:32.622311 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-e892bb9b-0ef1-429d-b859-4349d4ca3364 tempest-LiveMigrationTest-1883862344 None] Lock "b'cinder-a7d9fd1b-667e-4d1e-8a82-37e3314f37a1-delete_volume'" released by "delete_volume" :: held 14.518s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:26:02.735570 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-d3df9c1e-4405-4f94-957f-469e65dc6f6d req-ecfe213f-760f-4890-98c5-1675e83791f2 tempest-AttachVolumeNegativeTest-1449702691 None] Terminate volume connection completed successfully. May 02 10:26:02.745257 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-d3df9c1e-4405-4f94-957f-469e65dc6f6d req-ecfe213f-760f-4890-98c5-1675e83791f2 tempest-AttachVolumeNegativeTest-1449702691 None] Deleting attachment b5fe9c95-4259-4d56-bb44-a45b093dc34c. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:26:58.743145 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:26:58.743800 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:26:58.828124 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:26:58.918332 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:27:30.485017 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:27:30.529546 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Flow 'volume_create_manager' (ce619f17-7c7c-4854-9352-a42d2691553b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:27:30.552532 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce3d8f6-e792-4f1a-9609-2279f23aaa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:27:30.573011 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce3d8f6-e792-4f1a-9609-2279f23aaa9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-320591696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e07475c0-95fb-4c73-8c32-3a360dd3f083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c5102fde294e5fb3dbf22336934db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:27:30Z,use_quota=True,user_id='1cf4f9c1eeb94bff96fa42d2f20d805f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:27:30.579805 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe82f82a-e3b2-4a70-b229-69d8c7ed26f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:27:30.586526 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe82f82a-e3b2-4a70-b229-69d8c7ed26f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:27:30.592733 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069ff002-7ab5-4011-af37-7e7f0389d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:27:30.598517 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069ff002-7ab5-4011-af37-7e7f0389d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e07475c0-95fb-4c73-8c32-3a360dd3f083', 'volume_name': 'volume-e07475c0-95fb-4c73-8c32-3a360dd3f083', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:27:30.605066 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01e62e6-c0c9-443b-a4ee-25d7320c4f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:27:30.609634 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01e62e6-c0c9-443b-a4ee-25d7320c4f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:27:30.614899 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038cb722-8aa0-482a-8ad3-f9a8a1ee90ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:27:30.616389 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Volume e07475c0-95fb-4c73-8c32-3a360dd3f083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e07475c0-95fb-4c73-8c32-3a360dd3f083', 'volume_size': 1} May 02 10:27:30.617164 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] creating volume 'volume-e07475c0-95fb-4c73-8c32-3a360dd3f083' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:27:30.642720 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:27:31.775107 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:27:31.781051 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:27:31.782209 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038cb722-8aa0-482a-8ad3-f9a8a1ee90ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e07475c0-95fb-4c73-8c32-3a360dd3f083', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:27:31.792927 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64543f31-c0ac-4565-a9ae-2da2eb30648c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:27:31.947532 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Volume volume-e07475c0-95fb-4c73-8c32-3a360dd3f083 (e07475c0-95fb-4c73-8c32-3a360dd3f083): created successfully May 02 10:27:31.954334 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64543f31-c0ac-4565-a9ae-2da2eb30648c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:27:31.961550 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Flow 'volume_create_manager' (ce619f17-7c7c-4854-9352-a42d2691553b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:27:32.402742 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-ab4b5e1d-9101-4330-8eef-0b4060cfa547 tempest-AttachVolumeNegativeTest-1449702691 None] Created volume successfully. May 02 10:27:33.865535 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-d2b2bb5a-b7ce-483f-a46c-4892303223a2 req-5c898f3e-9085-419b-96fb-cb5a75e0ea89 tempest-AttachVolumeNegativeTest-1449702691 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:27:34.863092 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-d2b2bb5a-b7ce-483f-a46c-4892303223a2 req-5c898f3e-9085-419b-96fb-cb5a75e0ea89 tempest-AttachVolumeNegativeTest-1449702691 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.996s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:27:34.863092 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-d2b2bb5a-b7ce-483f-a46c-4892303223a2 req-5c898f3e-9085-419b-96fb-cb5a75e0ea89 tempest-AttachVolumeNegativeTest-1449702691 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e07475c0-95fb-4c73-8c32-3a360dd3f083', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'e07475c0-95fb-4c73-8c32-3a360dd3f083', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:27:35.065922 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-d2b2bb5a-b7ce-483f-a46c-4892303223a2 req-5c898f3e-9085-419b-96fb-cb5a75e0ea89 tempest-AttachVolumeNegativeTest-1449702691 None] Connection info returned from driver {'name': 'volumes/volume-e07475c0-95fb-4c73-8c32-3a360dd3f083', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e07475c0-95fb-4c73-8c32-3a360dd3f083', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8a289713-76c8-47a7-bb9a-06b5e7470758'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:27:35.251982 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-d2b2bb5a-b7ce-483f-a46c-4892303223a2 req-5c898f3e-9085-419b-96fb-cb5a75e0ea89 tempest-AttachVolumeNegativeTest-1449702691 None] attachment_update completed successfully. May 02 10:27:40.413027 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-40e1012b-808a-4bfb-96fc-384ebe33e1f9 req-012ab491-7cd1-45ee-a870-19c6a5060fd0 tempest-AttachVolumeNegativeTest-1449702691 None] Terminate volume connection completed successfully. May 02 10:27:40.414214 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-40e1012b-808a-4bfb-96fc-384ebe33e1f9 req-012ab491-7cd1-45ee-a870-19c6a5060fd0 tempest-AttachVolumeNegativeTest-1449702691 None] Deleting attachment 8a289713-76c8-47a7-bb9a-06b5e7470758. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:27:58.746163 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:27:58.747824 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:27:58.797219 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:27:58.900210 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:28:58.748108 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:28:58.753094 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:28:58.791697 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:28:58.840004 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:29:09.482538 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:29:09.505813 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Flow 'volume_create_manager' (b84a6f11-39bd-4d48-8e22-92d4f337dc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:29:09.513385 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc37a99-d4b0-4e88-9b32-21baf60fbe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:29:09.532525 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc37a99-d4b0-4e88-9b32-21baf60fbe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-203608683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=35d6dc2a-d533-494b-b294-017b74a81a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c5102fde294e5fb3dbf22336934db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:29:09Z,use_quota=True,user_id='1cf4f9c1eeb94bff96fa42d2f20d805f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:29:09.539778 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174b4613-d36f-419d-9446-2050a8298b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:29:09.549980 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174b4613-d36f-419d-9446-2050a8298b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:29:09.557351 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ff5005-f6c5-40a1-b341-b02dce2a4170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:29:09.563177 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ff5005-f6c5-40a1-b341-b02dce2a4170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d6dc2a-d533-494b-b294-017b74a81a21', 'volume_name': 'volume-35d6dc2a-d533-494b-b294-017b74a81a21', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:29:09.570066 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2ad09d-1680-431d-8c9a-02564142657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:29:09.576151 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2ad09d-1680-431d-8c9a-02564142657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:29:09.582051 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e20a85-874e-43b3-9da7-7e6617e16112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:29:09.584119 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Volume 35d6dc2a-d533-494b-b294-017b74a81a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d6dc2a-d533-494b-b294-017b74a81a21', 'volume_size': 1} May 02 10:29:09.585327 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] creating volume 'volume-35d6dc2a-d533-494b-b294-017b74a81a21' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:29:09.586828 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:29:10.443751 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:29:10.443751 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:29:10.443751 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e20a85-874e-43b3-9da7-7e6617e16112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d6dc2a-d533-494b-b294-017b74a81a21', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:29:10.448783 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0223a32e-30aa-48fe-bf97-4c555613e2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:29:10.577974 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Volume volume-35d6dc2a-d533-494b-b294-017b74a81a21 (35d6dc2a-d533-494b-b294-017b74a81a21): created successfully May 02 10:29:10.583884 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0223a32e-30aa-48fe-bf97-4c555613e2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:29:10.590235 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Flow 'volume_create_manager' (b84a6f11-39bd-4d48-8e22-92d4f337dc7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:29:10.703594 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-39d6c682-62ed-4934-b2a0-e5f7be4a1e28 tempest-AttachVolumeNegativeTest-1449702691 None] Created volume successfully. May 02 10:29:16.286474 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-09793353-8789-4e5f-b2d4-e7f563c38ace req-31724eeb-e62e-4b1e-b2b3-bd06da32a3e6 tempest-AttachVolumeNegativeTest-1449702691 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:29:17.408326 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-09793353-8789-4e5f-b2d4-e7f563c38ace req-31724eeb-e62e-4b1e-b2b3-bd06da32a3e6 tempest-AttachVolumeNegativeTest-1449702691 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.124s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:29:17.410690 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-09793353-8789-4e5f-b2d4-e7f563c38ace req-31724eeb-e62e-4b1e-b2b3-bd06da32a3e6 tempest-AttachVolumeNegativeTest-1449702691 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-35d6dc2a-d533-494b-b294-017b74a81a21', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '35d6dc2a-d533-494b-b294-017b74a81a21', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:29:17.566982 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-09793353-8789-4e5f-b2d4-e7f563c38ace req-31724eeb-e62e-4b1e-b2b3-bd06da32a3e6 tempest-AttachVolumeNegativeTest-1449702691 None] Connection info returned from driver {'name': 'volumes/volume-35d6dc2a-d533-494b-b294-017b74a81a21', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '35d6dc2a-d533-494b-b294-017b74a81a21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '805ca568-d835-418f-ac36-ba3f59189f57'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:29:17.731601 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-09793353-8789-4e5f-b2d4-e7f563c38ace req-31724eeb-e62e-4b1e-b2b3-bd06da32a3e6 tempest-AttachVolumeNegativeTest-1449702691 None] attachment_update completed successfully. May 02 10:29:22.902253 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-dc87ac9d-4bb5-4663-b164-007d56b54a8c req-5e3ca17b-5575-442e-9322-f4360680e232 tempest-AttachVolumeNegativeTest-1449702691 None] Terminate volume connection completed successfully. May 02 10:29:22.904773 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-dc87ac9d-4bb5-4663-b164-007d56b54a8c req-5e3ca17b-5575-442e-9322-f4360680e232 tempest-AttachVolumeNegativeTest-1449702691 None] Deleting attachment 805ca568-d835-418f-ac36-ba3f59189f57. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:29:34.577487 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-662f7d5a-9313-42f5-9f9d-9ccc9ef3cb0e tempest-AttachVolumeNegativeTest-1449702691 None] Lock "b'cinder-35d6dc2a-d533-494b-b294-017b74a81a21-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:29:34.718579 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-662f7d5a-9313-42f5-9f9d-9ccc9ef3cb0e tempest-AttachVolumeNegativeTest-1449702691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:29:35.000897 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-662f7d5a-9313-42f5-9f9d-9ccc9ef3cb0e tempest-AttachVolumeNegativeTest-1449702691 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:29:35.001522 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-662f7d5a-9313-42f5-9f9d-9ccc9ef3cb0e tempest-AttachVolumeNegativeTest-1449702691 None] Volume volume-35d6dc2a-d533-494b-b294-017b74a81a21 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:29:35.188377 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-662f7d5a-9313-42f5-9f9d-9ccc9ef3cb0e tempest-AttachVolumeNegativeTest-1449702691 None] deleting rbd volume volume-35d6dc2a-d533-494b-b294-017b74a81a21 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:29:43.166106 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-662f7d5a-9313-42f5-9f9d-9ccc9ef3cb0e tempest-AttachVolumeNegativeTest-1449702691 None] Created reservations ['6ffda554-6f0c-4108-bc8f-0c801b0caa0b', '240b7cbe-20e4-4a39-a773-2ce4469eabd4', '695e72e0-e653-450d-a41a-88ebfa064708', 'cd9a384e-c658-4f33-902a-b29becf15d60'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:29:43.405302 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-662f7d5a-9313-42f5-9f9d-9ccc9ef3cb0e tempest-AttachVolumeNegativeTest-1449702691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:29:43.496253 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-662f7d5a-9313-42f5-9f9d-9ccc9ef3cb0e tempest-AttachVolumeNegativeTest-1449702691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:29:43.584133 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-662f7d5a-9313-42f5-9f9d-9ccc9ef3cb0e tempest-AttachVolumeNegativeTest-1449702691 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:29:43.589103 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-662f7d5a-9313-42f5-9f9d-9ccc9ef3cb0e tempest-AttachVolumeNegativeTest-1449702691 None] Deleted volume successfully. May 02 10:29:43.695209 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-662f7d5a-9313-42f5-9f9d-9ccc9ef3cb0e tempest-AttachVolumeNegativeTest-1449702691 None] Lock "b'cinder-35d6dc2a-d533-494b-b294-017b74a81a21-delete_volume'" released by "delete_volume" :: held 9.118s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:29:44.831395 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-41cd1c8a-a746-44dc-a39d-67c1d6aa9604 tempest-AttachVolumeNegativeTest-1449702691 None] Lock "b'cinder-e07475c0-95fb-4c73-8c32-3a360dd3f083-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:29:44.982869 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41cd1c8a-a746-44dc-a39d-67c1d6aa9604 tempest-AttachVolumeNegativeTest-1449702691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:29:45.165004 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41cd1c8a-a746-44dc-a39d-67c1d6aa9604 tempest-AttachVolumeNegativeTest-1449702691 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:29:45.165771 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41cd1c8a-a746-44dc-a39d-67c1d6aa9604 tempest-AttachVolumeNegativeTest-1449702691 None] Volume volume-e07475c0-95fb-4c73-8c32-3a360dd3f083 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:29:45.395420 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41cd1c8a-a746-44dc-a39d-67c1d6aa9604 tempest-AttachVolumeNegativeTest-1449702691 None] deleting rbd volume volume-e07475c0-95fb-4c73-8c32-3a360dd3f083 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:29:52.773791 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-41cd1c8a-a746-44dc-a39d-67c1d6aa9604 tempest-AttachVolumeNegativeTest-1449702691 None] Created reservations ['ce9db278-801a-4396-ad36-ddc73fb663b7', 'b41fb563-34e5-4bd6-ad48-d124d6efe230', '85b5c4cb-48cd-4cea-a1e4-d31a957c0e8f', '67246c5f-8641-404a-bee5-c1fcc6ddc362'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:29:53.149539 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41cd1c8a-a746-44dc-a39d-67c1d6aa9604 tempest-AttachVolumeNegativeTest-1449702691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:29:53.220728 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41cd1c8a-a746-44dc-a39d-67c1d6aa9604 tempest-AttachVolumeNegativeTest-1449702691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:29:53.275398 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-41cd1c8a-a746-44dc-a39d-67c1d6aa9604 tempest-AttachVolumeNegativeTest-1449702691 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:29:53.281760 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-41cd1c8a-a746-44dc-a39d-67c1d6aa9604 tempest-AttachVolumeNegativeTest-1449702691 None] Deleted volume successfully. May 02 10:29:53.380593 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-41cd1c8a-a746-44dc-a39d-67c1d6aa9604 tempest-AttachVolumeNegativeTest-1449702691 None] Lock "b'cinder-e07475c0-95fb-4c73-8c32-3a360dd3f083-delete_volume'" released by "delete_volume" :: held 8.549s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:29:54.568877 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-05b5326d-1854-4189-8ffe-bb6b8bff5e75 tempest-AttachVolumeNegativeTest-1449702691 None] Lock "b'cinder-e1d06a54-376e-4770-a878-46b92d0cd536-delete_volume'" acquired by "delete_volume" :: waited 0.051s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:29:54.722403 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-05b5326d-1854-4189-8ffe-bb6b8bff5e75 tempest-AttachVolumeNegativeTest-1449702691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:29:55.141594 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-05b5326d-1854-4189-8ffe-bb6b8bff5e75 tempest-AttachVolumeNegativeTest-1449702691 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:29:55.142282 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-05b5326d-1854-4189-8ffe-bb6b8bff5e75 tempest-AttachVolumeNegativeTest-1449702691 None] Volume volume-e1d06a54-376e-4770-a878-46b92d0cd536 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:29:55.462621 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-05b5326d-1854-4189-8ffe-bb6b8bff5e75 tempest-AttachVolumeNegativeTest-1449702691 None] deleting rbd volume volume-e1d06a54-376e-4770-a878-46b92d0cd536 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:29:58.745982 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:29:58.747640 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:29:58.824417 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:29:58.864957 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:30:03.279317 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-05b5326d-1854-4189-8ffe-bb6b8bff5e75 tempest-AttachVolumeNegativeTest-1449702691 None] Created reservations ['5f24104c-9709-4ac9-b206-b626cc0a6b5a', '885798fe-1589-492d-a08a-e5e56a64660e', 'b33c839b-ecb5-4d15-9b44-0f19ebf5f531', '74a4fcd7-b0e8-4215-a3cd-f6a8fdebb140'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:30:03.526567 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-05b5326d-1854-4189-8ffe-bb6b8bff5e75 tempest-AttachVolumeNegativeTest-1449702691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:30:03.596036 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-05b5326d-1854-4189-8ffe-bb6b8bff5e75 tempest-AttachVolumeNegativeTest-1449702691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:30:03.659048 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-05b5326d-1854-4189-8ffe-bb6b8bff5e75 tempest-AttachVolumeNegativeTest-1449702691 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:30:03.672119 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-05b5326d-1854-4189-8ffe-bb6b8bff5e75 tempest-AttachVolumeNegativeTest-1449702691 None] Deleted volume successfully. May 02 10:30:03.838396 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-05b5326d-1854-4189-8ffe-bb6b8bff5e75 tempest-AttachVolumeNegativeTest-1449702691 None] Lock "b'cinder-e1d06a54-376e-4770-a878-46b92d0cd536-delete_volume'" released by "delete_volume" :: held 9.270s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:30:10.000846 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:30:10.061147 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Flow 'volume_create_manager' (ae23041e-06c8-483d-9646-a2dc22bbfd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:30:10.089452 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84646c0-851b-4a76-8248-901f4b806c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:30:10.135691 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84646c0-851b-4a76-8248-901f4b806c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1511172227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=051c51a5-608d-47c3-8798-accc5571cba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7bd47feb9549daaf4d186085f8d171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:30:10Z,use_quota=True,user_id='e3d3dea2740e4e46ae98265dcade1291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:30:10.154748 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356b0d8f-26f5-40c8-8bfe-044ce14a584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:30:10.168272 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356b0d8f-26f5-40c8-8bfe-044ce14a584d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:30:10.177698 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3454418-554a-46f0-a9c6-de045646608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:30:10.202770 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3454418-554a-46f0-a9c6-de045646608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051c51a5-608d-47c3-8798-accc5571cba4', 'volume_name': 'volume-051c51a5-608d-47c3-8798-accc5571cba4', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:30:10.208632 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06495ed-0a85-40c3-a6f2-fdd926744400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:30:10.227071 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06495ed-0a85-40c3-a6f2-fdd926744400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:30:10.238514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44561ca5-8f8f-4435-bd7e-3d3c8161e4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:30:10.239675 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Volume 051c51a5-608d-47c3-8798-accc5571cba4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051c51a5-608d-47c3-8798-accc5571cba4', 'volume_size': 1} May 02 10:30:10.241603 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] creating volume 'volume-051c51a5-608d-47c3-8798-accc5571cba4' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:30:10.241603 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:30:11.414601 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:30:11.415757 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:30:11.420171 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44561ca5-8f8f-4435-bd7e-3d3c8161e4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051c51a5-608d-47c3-8798-accc5571cba4', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:30:11.438650 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce4e35e-e4fa-41dd-8b5f-8a720d1755e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:30:11.559158 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Volume volume-051c51a5-608d-47c3-8798-accc5571cba4 (051c51a5-608d-47c3-8798-accc5571cba4): created successfully May 02 10:30:11.566404 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce4e35e-e4fa-41dd-8b5f-8a720d1755e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:30:11.569491 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Flow 'volume_create_manager' (ae23041e-06c8-483d-9646-a2dc22bbfd85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:30:11.698522 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-ada2faeb-8990-43b4-92da-836d900a9e7e tempest-DeleteServersTestJSON-671000602 None] Created volume successfully. May 02 10:30:13.498153 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-6fb858b7-1554-43d3-8a86-87ecc1fafe2a req-763db1a6-3bc3-4f57-a54e-a9c0c4edfbda tempest-DeleteServersTestJSON-671000602 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:30:14.621922 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-6fb858b7-1554-43d3-8a86-87ecc1fafe2a req-763db1a6-3bc3-4f57-a54e-a9c0c4edfbda tempest-DeleteServersTestJSON-671000602 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.127s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:30:14.622716 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-6fb858b7-1554-43d3-8a86-87ecc1fafe2a req-763db1a6-3bc3-4f57-a54e-a9c0c4edfbda tempest-DeleteServersTestJSON-671000602 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-051c51a5-608d-47c3-8798-accc5571cba4', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '051c51a5-608d-47c3-8798-accc5571cba4', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:30:14.720495 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-6fb858b7-1554-43d3-8a86-87ecc1fafe2a req-763db1a6-3bc3-4f57-a54e-a9c0c4edfbda tempest-DeleteServersTestJSON-671000602 None] Connection info returned from driver {'name': 'volumes/volume-051c51a5-608d-47c3-8798-accc5571cba4', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '051c51a5-608d-47c3-8798-accc5571cba4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bb2d1587-ba99-4f4e-bf08-c8d09f68bf06'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:30:14.939330 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-6fb858b7-1554-43d3-8a86-87ecc1fafe2a req-763db1a6-3bc3-4f57-a54e-a9c0c4edfbda tempest-DeleteServersTestJSON-671000602 None] attachment_update completed successfully. May 02 10:30:22.175005 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-cea76731-fc69-40da-862e-e8305bd532f0 req-5916ce8a-de3d-4b76-8333-cd87787728f4 tempest-DeleteServersTestJSON-671000602 None] Terminate volume connection completed successfully. May 02 10:30:22.175569 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-cea76731-fc69-40da-862e-e8305bd532f0 req-5916ce8a-de3d-4b76-8333-cd87787728f4 tempest-DeleteServersTestJSON-671000602 None] Deleting attachment bb2d1587-ba99-4f4e-bf08-c8d09f68bf06. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:30:35.042406 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-f8a606b1-331d-4700-9c11-4b00e13ca2ed tempest-ServersTestBootFromVolume-712353293 None] Terminate volume connection completed successfully. May 02 10:30:35.049097 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-f8a606b1-331d-4700-9c11-4b00e13ca2ed tempest-ServersTestBootFromVolume-712353293 None] Deleting attachment 727d6bd5-9fe5-4c5f-90b4-63bf76701be9. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:30:35.505284 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-4bc8889b-adc3-428d-a392-f019baa03fd5 tempest-ServersTestBootFromVolume-712353293 None] Lock "b'cinder-1cbc9d75-d395-469f-815a-9f92db5893d4-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:30:35.672537 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-4bc8889b-adc3-428d-a392-f019baa03fd5 tempest-ServersTestBootFromVolume-712353293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:30:35.994150 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-4bc8889b-adc3-428d-a392-f019baa03fd5 tempest-ServersTestBootFromVolume-712353293 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:30:35.994818 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-4bc8889b-adc3-428d-a392-f019baa03fd5 tempest-ServersTestBootFromVolume-712353293 None] volume has clone snapshot(s) {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1285}} May 02 10:30:35.998919 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-4bc8889b-adc3-428d-a392-f019baa03fd5 tempest-ServersTestBootFromVolume-712353293 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:30:37.564750 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-4bc8889b-adc3-428d-a392-f019baa03fd5 tempest-ServersTestBootFromVolume-712353293 None] Created reservations ['87c76aed-f4df-4bbd-8665-ed6db580feb6', '1603d75e-b901-4522-bcbd-55db68256ae6', '00a1c33b-c594-4fe7-b67c-4f787ee733a8', '9c461040-d5d6-4c7e-9be6-8816e44ce162'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:30:38.064149 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-4bc8889b-adc3-428d-a392-f019baa03fd5 tempest-ServersTestBootFromVolume-712353293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:30:38.170392 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-4bc8889b-adc3-428d-a392-f019baa03fd5 tempest-ServersTestBootFromVolume-712353293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:30:38.253297 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-4bc8889b-adc3-428d-a392-f019baa03fd5 tempest-ServersTestBootFromVolume-712353293 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:30:38.262765 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-4bc8889b-adc3-428d-a392-f019baa03fd5 tempest-ServersTestBootFromVolume-712353293 None] Deleted volume successfully. May 02 10:30:38.330469 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-88aa6c98-b7fb-4ccd-bb83-e2919735edaa req-4bc8889b-adc3-428d-a392-f019baa03fd5 tempest-ServersTestBootFromVolume-712353293 None] Lock "b'cinder-1cbc9d75-d395-469f-815a-9f92db5893d4-delete_volume'" released by "delete_volume" :: held 2.824s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:30:58.757916 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:30:58.759980 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:30:58.835316 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:30:58.931320 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:31:44.545022 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7ebb7680-f10f-4e8d-a14c-8a052af5d5dc tempest-BackendsCapabilitiesAdminTestsJSON-313654515 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:075422a1-5ad9-4b19-bac0-40a65c7914b1:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=123784) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} May 02 10:31:44.589136 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b3a99f43-f633-481b-9c06-3cfad80726d8 tempest-BackendsCapabilitiesAdminTestsJSON-313654515 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:075422a1-5ad9-4b19-bac0-40a65c7914b1:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=123784) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} May 02 10:31:58.746432 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:31:58.747781 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:31:59.100313 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:31:59.212063 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:32:04.150366 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:32:04.225214 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Flow 'volume_create_manager' (749bcd5b-1b9b-4d23-8e5e-d95e081e00f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:32:04.247982 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31108428-b22d-438f-aa25-3d38d0a131fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:04.291787 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31108428-b22d-438f-aa25-3d38d0a131fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-850097288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b96db587-26c4-4cbe-89de-191cbe42bc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2732a151c04314a5fcd1c95faaba90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:32:04Z,use_quota=True,user_id='e3f69b380ae641f1ac4879502e8b4cb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:04.321578 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4071a7a9-d5f0-47b9-8ad0-35f184f66e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:04.343637 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4071a7a9-d5f0-47b9-8ad0-35f184f66e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:04.348922 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbb288d-b7ca-4541-b3aa-af2b68cdfe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:04.366273 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbb288d-b7ca-4541-b3aa-af2b68cdfe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96db587-26c4-4cbe-89de-191cbe42bc54', 'volume_name': 'volume-b96db587-26c4-4cbe-89de-191cbe42bc54', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:04.381553 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b799ec-60fb-42b3-81e2-cb1b278018e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:04.389757 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b799ec-60fb-42b3-81e2-cb1b278018e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:04.400622 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6345c87-d7f9-49cb-b3fc-91073c336286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:04.402290 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Volume b96db587-26c4-4cbe-89de-191cbe42bc54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96db587-26c4-4cbe-89de-191cbe42bc54', 'volume_size': 1} May 02 10:32:04.402708 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] creating volume 'volume-b96db587-26c4-4cbe-89de-191cbe42bc54' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:32:04.403529 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:05.025041 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:32:05.025148 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:32:05.029745 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6345c87-d7f9-49cb-b3fc-91073c336286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96db587-26c4-4cbe-89de-191cbe42bc54', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:05.044759 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0949f4-69c9-41b7-9029-29e3f168b975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:05.139278 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Volume volume-b96db587-26c4-4cbe-89de-191cbe42bc54 (b96db587-26c4-4cbe-89de-191cbe42bc54): created successfully May 02 10:32:05.145791 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0949f4-69c9-41b7-9029-29e3f168b975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:05.157355 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Flow 'volume_create_manager' (749bcd5b-1b9b-4d23-8e5e-d95e081e00f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:32:05.235448 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e2194115-1f75-429a-b93b-cec4f490206a tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Created volume successfully. May 02 10:32:08.154613 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7c991969-2ba2-4913-b944-40b8bc12493d tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Lock "b'cinder-b96db587-26c4-4cbe-89de-191cbe42bc54-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:32:08.266572 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7c991969-2ba2-4913-b944-40b8bc12493d tempest-VolumeQuotasNegativeTestJSON-1814690865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:08.510302 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7c991969-2ba2-4913-b944-40b8bc12493d tempest-VolumeQuotasNegativeTestJSON-1814690865 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:32:08.510745 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7c991969-2ba2-4913-b944-40b8bc12493d tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Volume volume-b96db587-26c4-4cbe-89de-191cbe42bc54 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:32:08.614268 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7c991969-2ba2-4913-b944-40b8bc12493d tempest-VolumeQuotasNegativeTestJSON-1814690865 None] deleting rbd volume volume-b96db587-26c4-4cbe-89de-191cbe42bc54 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:32:12.499313 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-7c991969-2ba2-4913-b944-40b8bc12493d tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Created reservations ['5883a506-25d9-473c-90b7-f62335b1dc61', '8446a188-442e-4479-ac0f-2c086b40128e', '24a3867d-bfc7-422b-8294-66405c5095d9', '7c525792-b19a-4cf9-9b24-0a3ac906bdfc'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:32:12.751649 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7c991969-2ba2-4913-b944-40b8bc12493d tempest-VolumeQuotasNegativeTestJSON-1814690865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:12.862738 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7c991969-2ba2-4913-b944-40b8bc12493d tempest-VolumeQuotasNegativeTestJSON-1814690865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:12.951731 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-7c991969-2ba2-4913-b944-40b8bc12493d tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:32:12.959723 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-7c991969-2ba2-4913-b944-40b8bc12493d tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Deleted volume successfully. May 02 10:32:13.095921 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7c991969-2ba2-4913-b944-40b8bc12493d tempest-VolumeQuotasNegativeTestJSON-1814690865 None] Lock "b'cinder-b96db587-26c4-4cbe-89de-191cbe42bc54-delete_volume'" released by "delete_volume" :: held 4.941s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:32:16.918052 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:32:16.974480 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Flow 'volume_create_manager' (7a4044d4-dd54-4fd8-b377-fc813b918f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:32:16.992460 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984a709d-8160-416f-aba8-6c218c652ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:17.032431 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984a709d-8160-416f-aba8-6c218c652ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1975555208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=61cb175e-8cd9-4a41-959a-4f22a937c7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde37b6fb7fb45aa9279111ef4d5ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:32:17Z,use_quota=True,user_id='bb79a0a1ee5a429c9df27db4f671f0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:17.038730 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8555010-2d28-44ad-90be-afa458827e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:17.044054 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8555010-2d28-44ad-90be-afa458827e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:17.049891 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d2a251-f746-43cb-b666-7c13d313fd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:17.054473 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d2a251-f746-43cb-b666-7c13d313fd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61cb175e-8cd9-4a41-959a-4f22a937c7f1', 'volume_name': 'volume-61cb175e-8cd9-4a41-959a-4f22a937c7f1', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:17.060645 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7482ac9-6a47-4e13-bb49-37c3addb4e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:17.065011 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7482ac9-6a47-4e13-bb49-37c3addb4e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:17.070766 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb112ad-c986-4725-9fb7-29146b37d147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:17.072183 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Volume 61cb175e-8cd9-4a41-959a-4f22a937c7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61cb175e-8cd9-4a41-959a-4f22a937c7f1', 'volume_size': 1} May 02 10:32:17.072831 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] creating volume 'volume-61cb175e-8cd9-4a41-959a-4f22a937c7f1' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:32:17.074425 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:17.689020 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:32:17.691296 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:32:17.693115 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb112ad-c986-4725-9fb7-29146b37d147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61cb175e-8cd9-4a41-959a-4f22a937c7f1', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:17.697753 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d0f89b-44a5-4ec5-8056-6eb76188561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:17.814133 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Volume volume-61cb175e-8cd9-4a41-959a-4f22a937c7f1 (61cb175e-8cd9-4a41-959a-4f22a937c7f1): created successfully May 02 10:32:17.818381 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d0f89b-44a5-4ec5-8056-6eb76188561e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:17.824403 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Flow 'volume_create_manager' (7a4044d4-dd54-4fd8-b377-fc813b918f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:32:17.942884 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-391b574b-60bb-44c9-8bb1-773c2213777e tempest-ServersNegativeTestJSON-295755192 None] Created volume successfully. May 02 10:32:21.810433 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:32:21.855612 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Flow 'volume_create_manager' (08d71cb6-b35a-46b4-8df2-24decea234ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:32:21.875990 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c383d4e2-dc64-43cc-86c7-85d1ec0d3ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:21.919721 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c383d4e2-dc64-43cc-86c7-85d1ec0d3ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1126013669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=56d6d1d6-db11-4f6d-9169-b7f7ce248a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde37b6fb7fb45aa9279111ef4d5ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:32:22Z,use_quota=True,user_id='bb79a0a1ee5a429c9df27db4f671f0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:21.935173 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8565dd81-f7c1-47f4-a530-ebf6cc3dbf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:21.944468 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8565dd81-f7c1-47f4-a530-ebf6cc3dbf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:21.959388 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b8b126-e53d-4f92-8804-4111586dd3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:21.969460 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b8b126-e53d-4f92-8804-4111586dd3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d6d1d6-db11-4f6d-9169-b7f7ce248a1e', 'volume_name': 'volume-56d6d1d6-db11-4f6d-9169-b7f7ce248a1e', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:21.987126 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35518352-2af7-4d69-9f70-171b08b16992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:21.999983 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35518352-2af7-4d69-9f70-171b08b16992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:22.012912 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac745bc-e3c4-4f7d-84b7-bd8471c4241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:22.015581 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Volume 56d6d1d6-db11-4f6d-9169-b7f7ce248a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d6d1d6-db11-4f6d-9169-b7f7ce248a1e', 'volume_size': 1} May 02 10:32:22.017731 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] creating volume 'volume-56d6d1d6-db11-4f6d-9169-b7f7ce248a1e' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:32:22.020857 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:22.593664 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:32:22.594049 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:32:22.598609 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac745bc-e3c4-4f7d-84b7-bd8471c4241d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d6d1d6-db11-4f6d-9169-b7f7ce248a1e', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:22.616489 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93189e57-0669-4a8a-a8f3-6317dea376ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:22.710385 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Volume volume-56d6d1d6-db11-4f6d-9169-b7f7ce248a1e (56d6d1d6-db11-4f6d-9169-b7f7ce248a1e): created successfully May 02 10:32:22.714298 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93189e57-0669-4a8a-a8f3-6317dea376ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:22.722246 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Flow 'volume_create_manager' (08d71cb6-b35a-46b4-8df2-24decea234ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:32:22.785836 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3632e119-29ef-4ac7-bf97-85c5b057b92a tempest-ServersNegativeTestJSON-295755192 None] Created volume successfully. May 02 10:32:27.672790 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:32:27.696690 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Flow 'volume_create_manager' (15bcbd26-4e75-4530-8c26-ef1ffe8e856a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:32:27.705586 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d8d7ae-1b7e-4897-8475-88bf13f8dd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:27.726956 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d8d7ae-1b7e-4897-8475-88bf13f8dd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-681615070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9150cd6a-58f4-46a4-830b-7ad70073f256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80150bd642142428d02edc12b8f5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:32:27Z,use_quota=True,user_id='ca9888965cf94163bd0c9cdb5cc4a363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c54c7be7-3bc2-418e-8ddf-b1d79b61fca9),volume_type_id=c54c7be7-3bc2-418e-8ddf-b1d79b61fca9)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:27.734844 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616c0789-c089-4513-864a-c40f2154628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:27.740052 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616c0789-c089-4513-864a-c40f2154628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:27.747710 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21934cc-1ff7-48a6-8086-8a5b7157d959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:27.759351 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21934cc-1ff7-48a6-8086-8a5b7157d959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9150cd6a-58f4-46a4-830b-7ad70073f256', 'volume_name': 'volume-9150cd6a-58f4-46a4-830b-7ad70073f256', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:27.766586 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab01cc5-e1ac-4ae2-ab6a-3e4c52bec565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:27.773421 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab01cc5-e1ac-4ae2-ab6a-3e4c52bec565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:27.785766 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f96e9d-1176-420d-abb1-621a076ead14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:27.788207 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Volume 9150cd6a-58f4-46a4-830b-7ad70073f256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9150cd6a-58f4-46a4-830b-7ad70073f256', 'volume_size': 1} May 02 10:32:27.788207 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] creating volume 'volume-9150cd6a-58f4-46a4-830b-7ad70073f256' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:32:27.789166 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:28.386808 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:32:28.387648 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:32:28.395200 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f96e9d-1176-420d-abb1-621a076ead14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9150cd6a-58f4-46a4-830b-7ad70073f256', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:28.409211 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7e6e99-1266-4a87-b0c7-cc35927e4c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:28.556806 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Volume volume-9150cd6a-58f4-46a4-830b-7ad70073f256 (9150cd6a-58f4-46a4-830b-7ad70073f256): created successfully May 02 10:32:28.563668 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7e6e99-1266-4a87-b0c7-cc35927e4c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:28.582599 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Flow 'volume_create_manager' (15bcbd26-4e75-4530-8c26-ef1ffe8e856a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:32:28.664278 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a4a2c85e-4a3c-4058-a10e-eff69fb1f95d tempest-VolumeTypesAccessTest-347677737 None] Created volume successfully. May 02 10:32:30.687972 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] Lock "b'cinder-9150cd6a-58f4-46a4-830b-7ad70073f256-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:32:30.806518 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:31.069515 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:32:31.070005 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] Volume volume-9150cd6a-58f4-46a4-830b-7ad70073f256 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:32:31.151851 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] deleting rbd volume volume-9150cd6a-58f4-46a4-830b-7ad70073f256 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:32:34.555258 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-763359186 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-763359186, it is now deprecated. Please use the default quota class for default quota. May 02 10:32:34.555258 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-763359186 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-763359186, it is now deprecated. Please use the default quota class for default quota. May 02 10:32:34.630010 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] Created reservations ['2e213e35-3035-4422-b6a9-9d5211e10e3d', 'dea8409a-8306-4525-aee8-7162806166e0', 'e5891ea5-e010-4790-badf-457807cb052c', 'e1016098-ea73-4d8a-9428-27ac897a75a2'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:32:34.841160 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:34.895624 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:34.946442 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:32:34.951425 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] Deleted volume successfully. May 02 10:32:35.069690 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-48d51f39-467a-445c-90f4-27f03986da78 tempest-VolumeTypesAccessTest-347677737 None] Lock "b'cinder-9150cd6a-58f4-46a4-830b-7ad70073f256-delete_volume'" released by "delete_volume" :: held 4.382s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:32:54.409141 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:32:54.439024 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Flow 'volume_create_manager' (cc66b746-c833-4523-b035-129c08bdb881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:32:54.448804 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4235345f-31df-4bb7-bc3c-d7ec2cb52947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:54.469149 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4235345f-31df-4bb7-bc3c-d7ec2cb52947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-606187814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=89966900-483c-4073-aab8-014fe013d31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470a6d88d5b94bf69e729aa9ccb9be12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:32:54Z,use_quota=True,user_id='94002d1dd28b44aea254de29b78d44e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:54.495328 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfd01c2-4c01-4805-9c7a-597ea1722fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:54.506747 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfd01c2-4c01-4805-9c7a-597ea1722fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:54.542072 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607761e1-dc92-4647-87e8-52fcfc42b3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:54.697106 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607761e1-dc92-4647-87e8-52fcfc42b3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '89966900-483c-4073-aab8-014fe013d31b', 'volume_name': 'volume-89966900-483c-4073-aab8-014fe013d31b', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:54.718795 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55ab87b-c541-4f73-b89a-40d19e3c2e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:54.734072 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55ab87b-c541-4f73-b89a-40d19e3c2e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:54.747598 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bea35d9-e61e-4e41-899e-621404d330ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:54.749460 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Volume 89966900-483c-4073-aab8-014fe013d31b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-89966900-483c-4073-aab8-014fe013d31b', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:32:54.750066 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Cloning 89966900-483c-4073-aab8-014fe013d31b from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:32:54.762647 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:32:54.879229 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 32, 54, 772762)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:32:54.879906 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:32:54.880628 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:32:54.886159 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.123s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:32:54.892002 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:32:54.902094 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 32, 54, 891708)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:32:54.904314 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:32:54.905129 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:32:54.924176 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:55.110031 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] creating snapshot='volume-89966900-483c-4073-aab8-014fe013d31b.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:32:56.876057 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-89966900-483c-4073-aab8-014fe013d31b.clone_snap' to 'volume-89966900-483c-4073-aab8-014fe013d31b' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:32:58.100107 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:32:58.104395 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:32:58.106393 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:32:58.424344 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:32:58.425677 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Marking volume 89966900-483c-4073-aab8-014fe013d31b as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:32:58.503776 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 89966900-483c-4073-aab8-014fe013d31b. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:32:58.504213 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Creating volume glance metadata for volume 89966900-483c-4073-aab8-014fe013d31b backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:32:58.701818 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bea35d9-e61e-4e41-899e-621404d330ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89966900-483c-4073-aab8-014fe013d31b', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:58.707239 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042ce24a-a8ad-4dd4-930b-4ba0e452c802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:32:58.748239 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:32:58.754626 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:58.829781 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:32:58.895553 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:32:58.899959 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Volume volume-89966900-483c-4073-aab8-014fe013d31b (89966900-483c-4073-aab8-014fe013d31b): created successfully May 02 10:32:58.903825 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042ce24a-a8ad-4dd4-930b-4ba0e452c802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:32:58.909795 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Flow 'volume_create_manager' (cc66b746-c833-4523-b035-129c08bdb881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:32:58.977497 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-1a0ad386-7a61-4cdf-a833-e69facad94e5 tempest-VolumesImageMetadata-1798526021 None] Created volume successfully. May 02 10:33:00.375904 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-4a4b9d9c-4318-4f2c-b3e6-56cea54eca9b tempest-VolumesImageMetadata-1798526021 None] Lock "b'cinder-89966900-483c-4073-aab8-014fe013d31b-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:33:00.490213 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4a4b9d9c-4318-4f2c-b3e6-56cea54eca9b tempest-VolumesImageMetadata-1798526021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:00.706809 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4a4b9d9c-4318-4f2c-b3e6-56cea54eca9b tempest-VolumesImageMetadata-1798526021 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:33:00.779769 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4a4b9d9c-4318-4f2c-b3e6-56cea54eca9b tempest-VolumesImageMetadata-1798526021 None] deleting rbd volume volume-89966900-483c-4073-aab8-014fe013d31b {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:33:04.179253 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4a4b9d9c-4318-4f2c-b3e6-56cea54eca9b tempest-VolumesImageMetadata-1798526021 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:33:04.410292 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4a4b9d9c-4318-4f2c-b3e6-56cea54eca9b tempest-VolumesImageMetadata-1798526021 None] deleting parent snapshot volume-89966900-483c-4073-aab8-014fe013d31b.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:33:06.949083 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-4a4b9d9c-4318-4f2c-b3e6-56cea54eca9b tempest-VolumesImageMetadata-1798526021 None] Created reservations ['cf868510-4a8f-4716-97ef-7b7daa6fabdd', 'ecf40968-0252-44a8-af01-b8102cad9dc9', '2bb7082d-2caf-4e6c-9548-549f886f11a4', '152b4dd1-82bc-4082-9792-eaeb4983f7fd'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:33:07.230126 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4a4b9d9c-4318-4f2c-b3e6-56cea54eca9b tempest-VolumesImageMetadata-1798526021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:07.277116 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4a4b9d9c-4318-4f2c-b3e6-56cea54eca9b tempest-VolumesImageMetadata-1798526021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:07.394668 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-4a4b9d9c-4318-4f2c-b3e6-56cea54eca9b tempest-VolumesImageMetadata-1798526021 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:33:07.407049 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4a4b9d9c-4318-4f2c-b3e6-56cea54eca9b tempest-VolumesImageMetadata-1798526021 None] Deleted volume successfully. May 02 10:33:07.488530 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-4a4b9d9c-4318-4f2c-b3e6-56cea54eca9b tempest-VolumesImageMetadata-1798526021 None] Lock "b'cinder-89966900-483c-4073-aab8-014fe013d31b-delete_volume'" released by "delete_volume" :: held 7.109s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:33:13.482154 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:33:13.506552 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Flow 'volume_create_manager' (e9cb23b8-4aaa-4351-892b-83db8fc22da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:33:13.517373 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05785398-d5bd-4411-bae6-234038b2bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:13.531187 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05785398-d5bd-4411-bae6-234038b2bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-28138329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c6dc7f15-541a-43d2-bec9-51646dbcae5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67cc0a5d5e6a452e9991ef89d74248a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:33:13Z,use_quota=True,user_id='087b08c5319d401d85619b5b615923aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:13.536880 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b7f6ca-c35e-4fb7-9aca-c239896f674a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:13.542134 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b7f6ca-c35e-4fb7-9aca-c239896f674a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:13.547628 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a081fdd3-fb88-4107-8b63-bbc21ba76c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:13.551984 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a081fdd3-fb88-4107-8b63-bbc21ba76c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6dc7f15-541a-43d2-bec9-51646dbcae5d', 'volume_name': 'volume-c6dc7f15-541a-43d2-bec9-51646dbcae5d', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:13.557033 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c10b8c-0dcc-4a9c-a01e-38846d4b1571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:13.561188 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c10b8c-0dcc-4a9c-a01e-38846d4b1571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:13.566160 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee894cc9-2849-489c-af47-f9760fb77088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:13.567971 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Volume c6dc7f15-541a-43d2-bec9-51646dbcae5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6dc7f15-541a-43d2-bec9-51646dbcae5d', 'volume_size': 1} May 02 10:33:13.568588 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] creating volume 'volume-c6dc7f15-541a-43d2-bec9-51646dbcae5d' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:33:13.573422 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:14.208124 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:33:14.210668 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:33:14.217576 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee894cc9-2849-489c-af47-f9760fb77088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6dc7f15-541a-43d2-bec9-51646dbcae5d', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:14.223362 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a0f6a3-05cb-4d87-912b-df7b7bcbb9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:14.286554 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Volume volume-c6dc7f15-541a-43d2-bec9-51646dbcae5d (c6dc7f15-541a-43d2-bec9-51646dbcae5d): created successfully May 02 10:33:14.291573 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a0f6a3-05cb-4d87-912b-df7b7bcbb9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:14.297856 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Flow 'volume_create_manager' (e9cb23b8-4aaa-4351-892b-83db8fc22da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:33:14.349446 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-19e0e5ce-2cd9-4972-b5d4-7cd8d584fb9a tempest-SnapshotMetadataTestJSON-2123794033 None] Created volume successfully. May 02 10:33:16.219537 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-78be7e5a-5140-49e2-9070-91bb3da77aa5 tempest-SnapshotMetadataTestJSON-2123794033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:18.051924 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-78be7e5a-5140-49e2-9070-91bb3da77aa5 tempest-SnapshotMetadataTestJSON-2123794033 None] Create snapshot completed successfully May 02 10:33:19.665505 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:33:19.705180 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Flow 'volume_create_manager' (9eb2497e-5e6c-4e6b-b223-de5dfa932d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:33:19.723496 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6347d4-bfbc-4434-9de0-9a7469de15a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:19.744390 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6347d4-bfbc-4434-9de0-9a7469de15a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-464240986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4159f5ce4fb544c2bae494d5bcd6f3e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:33:19Z,use_quota=True,user_id='c337647f0fa340949df8761bceb1bafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:19.754715 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd38e5af-0350-40a0-b443-4f86bf31a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:19.761740 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd38e5af-0350-40a0-b443-4f86bf31a303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:19.770446 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b427f5-9196-4c11-ba43-d68441c8db0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:19.914078 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b427f5-9196-4c11-ba43-d68441c8db0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc', 'volume_name': 'volume-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:19.928020 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005755cd-a14a-489b-8efd-067cbf9f1097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:19.937812 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005755cd-a14a-489b-8efd-067cbf9f1097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:19.944017 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fea0c8a-e2f2-4fec-8a04-2e05e54b086d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:19.945678 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Volume 6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:33:19.946514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Cloning 6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:33:19.970571 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.023s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:33:20.029821 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 33, 19, 975772)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:33:20.035618 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:33:20.035618 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:33:20.038256 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.068s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:33:20.040086 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:33:20.048390 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 33, 20, 44060)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:33:20.049125 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:33:20.049765 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:33:20.065681 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:20.342979 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] creating snapshot='volume-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:33:21.503749 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc.clone_snap' to 'volume-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:33:21.540493 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-c9798db5-d3f5-4e47-84fe-20eb2ca23acf tempest-SnapshotMetadataTestJSON-2123794033 None] Lock "b'cinder-3624a74c-6c22-4e8f-8381-123c533093f3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.025s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:33:21.542283 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c9798db5-d3f5-4e47-84fe-20eb2ca23acf tempest-SnapshotMetadataTestJSON-2123794033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:23.221216 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:33:23.223760 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:33:23.224327 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:33:23.472737 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:33:23.473364 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Marking volume 6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:33:23.560618 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:33:23.561546 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Creating volume glance metadata for volume 6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:33:23.703147 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fea0c8a-e2f2-4fec-8a04-2e05e54b086d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:23.711347 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8d63ab-ebe8-4c1e-901a-cd044e10e254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:23.800906 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Volume volume-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc (6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc): created successfully May 02 10:33:23.808225 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8d63ab-ebe8-4c1e-901a-cd044e10e254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:23.830784 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Flow 'volume_create_manager' (9eb2497e-5e6c-4e6b-b223-de5dfa932d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:33:23.989816 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-41b596e2-9c05-4484-abb0-34f7a8c57843 tempest-TaggedBootDevicesTest-94249343 None] Created volume successfully. May 02 10:33:24.618718 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-c9798db5-d3f5-4e47-84fe-20eb2ca23acf tempest-SnapshotMetadataTestJSON-2123794033 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. May 02 10:33:24.686245 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-c9798db5-d3f5-4e47-84fe-20eb2ca23acf tempest-SnapshotMetadataTestJSON-2123794033 None] Created reservations ['9530103b-de61-44be-8574-17eddbdb6e14', 'd0d37ffb-6323-487c-96b9-6bf19bba1dc2', 'f6eefacd-d7cb-4180-a64f-58ed9146af01', '5496255a-5282-4d76-9eb9-9a47523b380b'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:33:24.959168 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-c9798db5-d3f5-4e47-84fe-20eb2ca23acf tempest-SnapshotMetadataTestJSON-2123794033 None] Delete snapshot completed successfully. May 02 10:33:24.961051 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-c9798db5-d3f5-4e47-84fe-20eb2ca23acf tempest-SnapshotMetadataTestJSON-2123794033 None] Lock "b'cinder-3624a74c-6c22-4e8f-8381-123c533093f3-delete_snapshot'" released by "delete_snapshot" :: held 3.421s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:33:25.687545 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:33:25.727824 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Flow 'volume_create_manager' (859615ee-02f6-4756-9002-41c8adcc836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:33:25.735791 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bde00f-5f12-457d-912b-4f36729bc6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:25.799742 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bde00f-5f12-457d-912b-4f36729bc6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1662151712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6f534bd2-f64f-401c-9854-a30e90688a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4159f5ce4fb544c2bae494d5bcd6f3e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:33:26Z,use_quota=True,user_id='c337647f0fa340949df8761bceb1bafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:25.811954 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9429b600-b076-4675-b41e-67742bb8404b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:25.821220 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9429b600-b076-4675-b41e-67742bb8404b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:25.827612 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5bf931-854c-4808-9014-214196e17487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:25.836198 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5bf931-854c-4808-9014-214196e17487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f534bd2-f64f-401c-9854-a30e90688a18', 'volume_name': 'volume-6f534bd2-f64f-401c-9854-a30e90688a18', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:25.842033 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dd19af-ae9d-4976-a751-f5d4543a39ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:25.846603 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dd19af-ae9d-4976-a751-f5d4543a39ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:25.851859 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ddf899-418c-4563-90ac-176fa136c8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:25.853181 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Volume 6f534bd2-f64f-401c-9854-a30e90688a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f534bd2-f64f-401c-9854-a30e90688a18', 'volume_size': 1} May 02 10:33:25.853883 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] creating volume 'volume-6f534bd2-f64f-401c-9854-a30e90688a18' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:33:25.857936 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:25.883279 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-78314019-b148-4378-95db-6f9cff4da62c tempest-SnapshotMetadataTestJSON-2123794033 None] Lock "b'cinder-c6dc7f15-541a-43d2-bec9-51646dbcae5d-delete_volume'" acquired by "delete_volume" :: waited 0.128s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:33:25.974425 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-78314019-b148-4378-95db-6f9cff4da62c tempest-SnapshotMetadataTestJSON-2123794033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:26.263576 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-78314019-b148-4378-95db-6f9cff4da62c tempest-SnapshotMetadataTestJSON-2123794033 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:33:26.266143 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-78314019-b148-4378-95db-6f9cff4da62c tempest-SnapshotMetadataTestJSON-2123794033 None] Volume volume-c6dc7f15-541a-43d2-bec9-51646dbcae5d is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:33:26.514964 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-78314019-b148-4378-95db-6f9cff4da62c tempest-SnapshotMetadataTestJSON-2123794033 None] deleting rbd volume volume-c6dc7f15-541a-43d2-bec9-51646dbcae5d {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:33:26.612841 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:33:26.613381 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:33:26.617849 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ddf899-418c-4563-90ac-176fa136c8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f534bd2-f64f-401c-9854-a30e90688a18', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:26.622729 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a6bcd7-19a7-4f23-ba85-abf4e442cf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:26.677281 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Volume volume-6f534bd2-f64f-401c-9854-a30e90688a18 (6f534bd2-f64f-401c-9854-a30e90688a18): created successfully May 02 10:33:26.681036 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a6bcd7-19a7-4f23-ba85-abf4e442cf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:26.686546 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Flow 'volume_create_manager' (859615ee-02f6-4756-9002-41c8adcc836e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:33:26.759790 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3fecb811-2f75-44df-8b58-787e018ffd74 tempest-TaggedBootDevicesTest-94249343 None] Created volume successfully. May 02 10:33:28.693145 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:33:28.732082 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Flow 'volume_create_manager' (d115afaa-71a4-4aca-a279-169c89ae5ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:33:28.747297 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98267d83-3635-4664-a9bb-bad270825d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:28.809686 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98267d83-3635-4664-a9bb-bad270825d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1374363354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=79fcb3f4-38e9-4ce5-9872-fe92fc99d572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4159f5ce4fb544c2bae494d5bcd6f3e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:33:28Z,use_quota=True,user_id='c337647f0fa340949df8761bceb1bafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:28.821700 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc87de61-5c5e-4de1-a099-1531e3faa308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:28.828920 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc87de61-5c5e-4de1-a099-1531e3faa308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:28.835430 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640c0ecb-7ba9-4269-af70-a71c442c7d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:28.840501 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640c0ecb-7ba9-4269-af70-a71c442c7d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79fcb3f4-38e9-4ce5-9872-fe92fc99d572', 'volume_name': 'volume-79fcb3f4-38e9-4ce5-9872-fe92fc99d572', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:28.846227 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27623013-4205-45f7-8fe5-83876d5c3c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:28.851757 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27623013-4205-45f7-8fe5-83876d5c3c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:28.857972 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65e18f2-715e-48eb-b612-93dd3551949e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:28.859307 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Volume 79fcb3f4-38e9-4ce5-9872-fe92fc99d572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79fcb3f4-38e9-4ce5-9872-fe92fc99d572', 'volume_size': 1} May 02 10:33:28.859913 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] creating volume 'volume-79fcb3f4-38e9-4ce5-9872-fe92fc99d572' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:33:28.860816 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:29.612594 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:33:29.612766 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:33:29.625730 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65e18f2-715e-48eb-b612-93dd3551949e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fcb3f4-38e9-4ce5-9872-fe92fc99d572', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:29.644346 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681fd3b2-4529-4f13-8c2d-4ece986290a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:29.748565 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Volume volume-79fcb3f4-38e9-4ce5-9872-fe92fc99d572 (79fcb3f4-38e9-4ce5-9872-fe92fc99d572): created successfully May 02 10:33:29.765794 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681fd3b2-4529-4f13-8c2d-4ece986290a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:29.787599 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Flow 'volume_create_manager' (d115afaa-71a4-4aca-a279-169c89ae5ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:33:29.920945 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-9f1201c3-9511-4e5d-9f15-4f9c16430932 tempest-TaggedBootDevicesTest-94249343 None] Created volume successfully. May 02 10:33:30.520910 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-78314019-b148-4378-95db-6f9cff4da62c tempest-SnapshotMetadataTestJSON-2123794033 None] Created reservations ['1cee60ab-2cde-456e-a78b-1d5733dd48c2', 'b850d638-7d01-4cda-8974-31e13ff9a73b', '789fd569-e32f-4d0a-95c9-9e20475b00d8', '63fcf77c-a9aa-46c7-a536-113f9f133a79'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:33:30.757110 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-78314019-b148-4378-95db-6f9cff4da62c tempest-SnapshotMetadataTestJSON-2123794033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:30.857037 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-78314019-b148-4378-95db-6f9cff4da62c tempest-SnapshotMetadataTestJSON-2123794033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:30.985046 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-78314019-b148-4378-95db-6f9cff4da62c tempest-SnapshotMetadataTestJSON-2123794033 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:33:30.996235 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-78314019-b148-4378-95db-6f9cff4da62c tempest-SnapshotMetadataTestJSON-2123794033 None] Deleted volume successfully. May 02 10:33:31.068647 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-78314019-b148-4378-95db-6f9cff4da62c tempest-SnapshotMetadataTestJSON-2123794033 None] Lock "b'cinder-c6dc7f15-541a-43d2-bec9-51646dbcae5d-delete_volume'" released by "delete_volume" :: held 5.183s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:33:38.629708 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:33:38.679485 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Flow 'volume_create_manager' (439fff2c-b444-41e7-b4f6-6b272c79e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:33:38.692316 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3475d55f-a4b4-40ba-ba37-b95a250e96a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:38.730167 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3475d55f-a4b4-40ba-ba37-b95a250e96a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1043600025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f394ac4d-d794-4f2c-8077-b7c957da464f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44303f0df72a46058e13a869110175a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:33:38Z,use_quota=True,user_id='6efa82b4e40e4ac7a4acef8a549147f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:38.738537 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0362eb-e7d6-4358-bd7a-6d3bfce2e75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:38.756913 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0362eb-e7d6-4358-bd7a-6d3bfce2e75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:38.773104 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0670cf8-c31f-4eee-97fe-f10fe022e5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:38.777932 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0670cf8-c31f-4eee-97fe-f10fe022e5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f394ac4d-d794-4f2c-8077-b7c957da464f', 'volume_name': 'volume-f394ac4d-d794-4f2c-8077-b7c957da464f', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:38.788901 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bc52ac-eb44-4f6e-b1d0-a5a7ad80a51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:38.797287 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bc52ac-eb44-4f6e-b1d0-a5a7ad80a51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:38.806988 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97847e3-4782-4933-b4aa-d23d87f788b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:38.808717 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Volume f394ac4d-d794-4f2c-8077-b7c957da464f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f394ac4d-d794-4f2c-8077-b7c957da464f', 'volume_size': 1} May 02 10:33:38.809378 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] creating volume 'volume-f394ac4d-d794-4f2c-8077-b7c957da464f' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:33:38.810935 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:39.615293 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:33:39.616847 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:33:39.621236 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97847e3-4782-4933-b4aa-d23d87f788b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f394ac4d-d794-4f2c-8077-b7c957da464f', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:39.639849 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eb1cfd-0b61-4e59-9e09-ec074d0009fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:33:39.728279 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Volume volume-f394ac4d-d794-4f2c-8077-b7c957da464f (f394ac4d-d794-4f2c-8077-b7c957da464f): created successfully May 02 10:33:39.743428 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eb1cfd-0b61-4e59-9e09-ec074d0009fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:33:39.804593 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Flow 'volume_create_manager' (439fff2c-b444-41e7-b4f6-6b272c79e401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:33:40.074316 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-33136875-6d43-479a-807c-fe1c606efec4 tempest-VolumesDeleteCascade-1906652141 None] Created volume successfully. May 02 10:33:41.328973 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8f263c44-2ada-412d-b666-9255537adf04 tempest-VolumesDeleteCascade-1906652141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:43.441791 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-8f263c44-2ada-412d-b666-9255537adf04 tempest-VolumesDeleteCascade-1906652141 None] Create snapshot completed successfully May 02 10:33:45.162928 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fe164161-d95e-4973-b6a1-f5dc08e7990e tempest-VolumesDeleteCascade-1906652141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:47.131282 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-fe164161-d95e-4973-b6a1-f5dc08e7990e tempest-VolumesDeleteCascade-1906652141 None] Create snapshot completed successfully May 02 10:33:48.758188 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Lock "b'cinder-f394ac4d-d794-4f2c-8077-b7c957da464f-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:33:48.881998 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Performing cascade delete. {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/manager.py:964}} May 02 10:33:48.920120 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Lock "b'cinder-90d07a18-5828-4745-b580-58b66608f63f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.028s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:33:48.950961 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:51.468613 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Created reservations ['81204a9c-5d74-476f-af7c-94db223be658', '77c3273c-fc68-4202-9e76-309072f1073a', '0456a282-91c7-4435-a51c-22f72c5c08e3', '1ccbe716-b4b3-4115-b2ae-204e406bb269'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:33:51.696560 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Delete snapshot completed successfully. May 02 10:33:51.702000 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Lock "b'cinder-90d07a18-5828-4745-b580-58b66608f63f-delete_snapshot'" released by "delete_snapshot" :: held 2.782s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:33:51.717852 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Lock "b'cinder-e2de7989-179d-45a8-84bc-251f604ee672-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:33:51.757279 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:54.199553 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Created reservations ['a0f597d6-0985-4d39-b2dc-839c0f02e3ff', '58666d81-640d-4d34-8564-0606abc21693', '50c36e1a-00f5-4d16-ae9b-3585fc1e117c', 'd9112345-d624-4226-84e6-492bfdba24ba'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:33:54.422371 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Delete snapshot completed successfully. May 02 10:33:54.428591 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Lock "b'cinder-e2de7989-179d-45a8-84bc-251f604ee672-delete_snapshot'" released by "delete_snapshot" :: held 2.711s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:33:54.429507 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Snapshots deleted, issuing volume delete {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/manager.py:979}} May 02 10:33:54.431018 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:54.589141 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:33:54.589892 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Volume volume-f394ac4d-d794-4f2c-8077-b7c957da464f is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:33:54.675071 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] deleting rbd volume volume-f394ac4d-d794-4f2c-8077-b7c957da464f {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:33:58.045644 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Created reservations ['4cb75fd6-9cf3-4cf1-8f02-f8539d735c72', 'f99047cc-f636-46b8-b752-e237c5f9b9aa', '717084c6-3e91-4e3b-8aa8-bcc3c834c587', '7a7aba1b-01d0-45d9-aa0f-667bcedb7541'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:33:58.338703 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:58.462405 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:58.525729 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:33:58.531302 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Deleted volume successfully. May 02 10:33:58.610307 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-bcc9f849-ce23-404a-984d-ed85a1796b71 tempest-VolumesDeleteCascade-1906652141 None] Lock "b'cinder-f394ac4d-d794-4f2c-8077-b7c957da464f-delete_volume'" released by "delete_volume" :: held 9.852s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:33:58.747619 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:33:58.748672 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:58.851493 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:33:58.925936 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:34:03.652258 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-a33a3863-e6ba-42de-9870-fe9b775766a6 tempest-TaggedBootDevicesTest-94249343 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:34:05.013883 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:34:05.063944 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Flow 'volume_create_manager' (b0ba8068-6f00-47ed-b688-8f7201f8269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:34:05.093120 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8584acd9-1479-46df-9952-10d26066fdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:34:05.139413 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8584acd9-1479-46df-9952-10d26066fdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1122347308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2578038-c1f9-4b64-86bf-afc31a45ac1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58aa2745261044759f71e557f5c3808f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:34:05Z,use_quota=True,user_id='7d95ecff0c864990a2fce75a398874e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:34:05.154889 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a4b8ed-835c-49b2-b84c-68c4e102403a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:34:05.162595 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a4b8ed-835c-49b2-b84c-68c4e102403a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:34:05.179328 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289bba1d-e638-4ffa-a580-8a9e73949fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:34:05.191853 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289bba1d-e638-4ffa-a580-8a9e73949fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2578038-c1f9-4b64-86bf-afc31a45ac1e', 'volume_name': 'volume-b2578038-c1f9-4b64-86bf-afc31a45ac1e', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:34:05.204890 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2a79c2-fa19-4207-a376-11ace9e34ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:34:05.212555 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2a79c2-fa19-4207-a376-11ace9e34ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:34:05.231713 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8103b51c-7812-4694-8cdb-aea3a6a7e44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:34:05.233023 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Volume b2578038-c1f9-4b64-86bf-afc31a45ac1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2578038-c1f9-4b64-86bf-afc31a45ac1e', 'volume_size': 1} May 02 10:34:05.233456 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] creating volume 'volume-b2578038-c1f9-4b64-86bf-afc31a45ac1e' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:34:05.234711 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:34:05.318724 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-a33a3863-e6ba-42de-9870-fe9b775766a6 tempest-TaggedBootDevicesTest-94249343 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.667s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:34:05.321878 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-a33a3863-e6ba-42de-9870-fe9b775766a6 tempest-TaggedBootDevicesTest-94249343 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:34:05.447095 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-a33a3863-e6ba-42de-9870-fe9b775766a6 tempest-TaggedBootDevicesTest-94249343 None] Connection info returned from driver {'name': 'volumes/volume-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '062ac103-254b-4569-bc4c-ec808aa18b8b'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:34:05.578392 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-a33a3863-e6ba-42de-9870-fe9b775766a6 tempest-TaggedBootDevicesTest-94249343 None] attachment_update completed successfully. May 02 10:34:05.834494 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:34:05.838334 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:34:05.839251 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8103b51c-7812-4694-8cdb-aea3a6a7e44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2578038-c1f9-4b64-86bf-afc31a45ac1e', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:34:05.845232 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f213272d-46ba-4991-a00a-4cb40e92992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:34:05.995892 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-389f33a4-aea5-4d59-badb-91e8c24ac699 tempest-DeleteServersTestJSON-671000602 None] Lock "b'cinder-051c51a5-608d-47c3-8798-accc5571cba4-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:34:06.011987 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Volume volume-b2578038-c1f9-4b64-86bf-afc31a45ac1e (b2578038-c1f9-4b64-86bf-afc31a45ac1e): created successfully May 02 10:34:06.023443 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f213272d-46ba-4991-a00a-4cb40e92992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:34:06.036780 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Flow 'volume_create_manager' (b0ba8068-6f00-47ed-b688-8f7201f8269b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:34:06.116891 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-389f33a4-aea5-4d59-badb-91e8c24ac699 tempest-DeleteServersTestJSON-671000602 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:34:06.302178 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-389f33a4-aea5-4d59-badb-91e8c24ac699 tempest-DeleteServersTestJSON-671000602 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:34:06.303331 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-389f33a4-aea5-4d59-badb-91e8c24ac699 tempest-DeleteServersTestJSON-671000602 None] Volume volume-051c51a5-608d-47c3-8798-accc5571cba4 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:34:06.394181 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-389f33a4-aea5-4d59-badb-91e8c24ac699 tempest-DeleteServersTestJSON-671000602 None] deleting rbd volume volume-051c51a5-608d-47c3-8798-accc5571cba4 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:34:06.395111 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-1f7b8526-ff0c-40ce-ad5b-9a432ec9f238 tempest-VolumesMetadataTest-1144255206 None] Created volume successfully. May 02 10:34:06.469252 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-e273c96e-d462-45ab-99ff-3bb6ffae7adc tempest-TaggedBootDevicesTest-94249343 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:34:08.359325 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-e273c96e-d462-45ab-99ff-3bb6ffae7adc tempest-TaggedBootDevicesTest-94249343 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.890s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:34:08.361552 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-e273c96e-d462-45ab-99ff-3bb6ffae7adc tempest-TaggedBootDevicesTest-94249343 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6f534bd2-f64f-401c-9854-a30e90688a18', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '6f534bd2-f64f-401c-9854-a30e90688a18', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:34:08.545863 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-e273c96e-d462-45ab-99ff-3bb6ffae7adc tempest-TaggedBootDevicesTest-94249343 None] Connection info returned from driver {'name': 'volumes/volume-6f534bd2-f64f-401c-9854-a30e90688a18', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6f534bd2-f64f-401c-9854-a30e90688a18', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b34629fb-0c14-4370-a2c0-783c6a2db4c1'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:34:08.735570 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-e273c96e-d462-45ab-99ff-3bb6ffae7adc tempest-TaggedBootDevicesTest-94249343 None] attachment_update completed successfully. May 02 10:34:09.683930 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-d3229a03-0a57-4f44-9a4b-eefc75d9721c tempest-TaggedBootDevicesTest-94249343 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:34:10.025750 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-c6aaf630-7d3e-42e5-b125-2e3edd42c19c tempest-VolumesMetadataTest-1144255206 None] Lock "b'cinder-b2578038-c1f9-4b64-86bf-afc31a45ac1e-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:34:10.188451 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6aaf630-7d3e-42e5-b125-2e3edd42c19c tempest-VolumesMetadataTest-1144255206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:34:10.421801 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6aaf630-7d3e-42e5-b125-2e3edd42c19c tempest-VolumesMetadataTest-1144255206 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:34:10.422387 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6aaf630-7d3e-42e5-b125-2e3edd42c19c tempest-VolumesMetadataTest-1144255206 None] Volume volume-b2578038-c1f9-4b64-86bf-afc31a45ac1e is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:34:10.525055 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6aaf630-7d3e-42e5-b125-2e3edd42c19c tempest-VolumesMetadataTest-1144255206 None] deleting rbd volume volume-b2578038-c1f9-4b64-86bf-afc31a45ac1e {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:34:10.680737 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-389f33a4-aea5-4d59-badb-91e8c24ac699 tempest-DeleteServersTestJSON-671000602 None] Created reservations ['e7ffee11-0529-4369-bb3d-4856a443d04b', 'd082bfd4-4556-47ef-a7d4-3ae7df1dc0ea', '893ffc54-8781-4bf2-8cd0-e40378e8c183', '1e9810f8-7e6d-4c51-815d-7b2c9d59002f'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:34:10.908902 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-389f33a4-aea5-4d59-badb-91e8c24ac699 tempest-DeleteServersTestJSON-671000602 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:34:11.111678 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-389f33a4-aea5-4d59-badb-91e8c24ac699 tempest-DeleteServersTestJSON-671000602 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:34:11.336854 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-389f33a4-aea5-4d59-badb-91e8c24ac699 tempest-DeleteServersTestJSON-671000602 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:34:11.351928 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-389f33a4-aea5-4d59-badb-91e8c24ac699 tempest-DeleteServersTestJSON-671000602 None] Deleted volume successfully. May 02 10:34:11.452484 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-389f33a4-aea5-4d59-badb-91e8c24ac699 tempest-DeleteServersTestJSON-671000602 None] Lock "b'cinder-051c51a5-608d-47c3-8798-accc5571cba4-delete_volume'" released by "delete_volume" :: held 5.457s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:34:12.222477 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-d3229a03-0a57-4f44-9a4b-eefc75d9721c tempest-TaggedBootDevicesTest-94249343 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.539s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:34:12.223961 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-d3229a03-0a57-4f44-9a4b-eefc75d9721c tempest-TaggedBootDevicesTest-94249343 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-79fcb3f4-38e9-4ce5-9872-fe92fc99d572', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '79fcb3f4-38e9-4ce5-9872-fe92fc99d572', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:34:12.342319 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-d3229a03-0a57-4f44-9a4b-eefc75d9721c tempest-TaggedBootDevicesTest-94249343 None] Connection info returned from driver {'name': 'volumes/volume-79fcb3f4-38e9-4ce5-9872-fe92fc99d572', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '79fcb3f4-38e9-4ce5-9872-fe92fc99d572', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6cda1646-ca1c-4812-8a96-5cf9fe2719ba'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:34:12.537533 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-c3c7b64b-c21b-43c7-94c1-42884f64a79a req-d3229a03-0a57-4f44-9a4b-eefc75d9721c tempest-TaggedBootDevicesTest-94249343 None] attachment_update completed successfully. May 02 10:34:14.009882 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-c6aaf630-7d3e-42e5-b125-2e3edd42c19c tempest-VolumesMetadataTest-1144255206 None] Created reservations ['dfdc9d9c-1439-43a8-9958-7100bf180e0f', 'c6a64fbf-4bd4-4678-a29c-4d841d4fbd45', '9bcc62d0-c074-4401-a0b2-e73a283afe54', '9a90c429-5144-4f85-a30d-144564ed0071'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:34:14.486121 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6aaf630-7d3e-42e5-b125-2e3edd42c19c tempest-VolumesMetadataTest-1144255206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:34:14.609734 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6aaf630-7d3e-42e5-b125-2e3edd42c19c tempest-VolumesMetadataTest-1144255206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:34:14.692409 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-c6aaf630-7d3e-42e5-b125-2e3edd42c19c tempest-VolumesMetadataTest-1144255206 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:34:14.704567 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-c6aaf630-7d3e-42e5-b125-2e3edd42c19c tempest-VolumesMetadataTest-1144255206 None] Deleted volume successfully. May 02 10:34:14.792785 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-c6aaf630-7d3e-42e5-b125-2e3edd42c19c tempest-VolumesMetadataTest-1144255206 None] Lock "b'cinder-b2578038-c1f9-4b64-86bf-afc31a45ac1e-delete_volume'" released by "delete_volume" :: held 4.769s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:34:22.647707 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:34:22.717346 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Flow 'volume_create_manager' (169baa5f-be4f-4773-9fb7-f554cd7317a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:34:22.747944 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7601b71-0033-4df3-86ec-a2dc7ca0545e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:34:22.865211 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7601b71-0033-4df3-86ec-a2dc7ca0545e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-96456249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1451bbe-299e-4929-a8c1-a7b89b9e9f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56a059bb653d412f81c66dfd5c50806c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:34:22Z,use_quota=True,user_id='f70906b656804455a60b4be9f825869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:34:22.894563 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d56495-00dc-4e6f-bfc2-6a77e7df8466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:34:22.928535 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d56495-00dc-4e6f-bfc2-6a77e7df8466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:34:22.967725 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2899b5-c513-4af8-9aaf-a1f24052de4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:34:23.000152 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2899b5-c513-4af8-9aaf-a1f24052de4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1451bbe-299e-4929-a8c1-a7b89b9e9f18', 'volume_name': 'volume-c1451bbe-299e-4929-a8c1-a7b89b9e9f18', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:34:23.031423 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9a9c23-24c5-4dfc-bb56-bf0e0dcfb9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:34:23.050096 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9a9c23-24c5-4dfc-bb56-bf0e0dcfb9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:34:23.075919 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33db622e-13b3-4b21-8daa-65d91a6310b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:34:23.083308 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Volume c1451bbe-299e-4929-a8c1-a7b89b9e9f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1451bbe-299e-4929-a8c1-a7b89b9e9f18', 'volume_size': 1} May 02 10:34:23.083728 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] creating volume 'volume-c1451bbe-299e-4929-a8c1-a7b89b9e9f18' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:34:23.087669 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:34:24.076678 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:34:24.077886 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:34:24.082510 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33db622e-13b3-4b21-8daa-65d91a6310b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1451bbe-299e-4929-a8c1-a7b89b9e9f18', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:34:24.116904 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd2aab5-c0a6-4836-b9a9-640d6e10ecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:34:24.198823 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Volume volume-c1451bbe-299e-4929-a8c1-a7b89b9e9f18 (c1451bbe-299e-4929-a8c1-a7b89b9e9f18): created successfully May 02 10:34:24.205061 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd2aab5-c0a6-4836-b9a9-640d6e10ecff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:34:24.234018 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Flow 'volume_create_manager' (169baa5f-be4f-4773-9fb7-f554cd7317a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:34:24.325090 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-fd5e922d-d5eb-4353-8ca0-580ea87f4ba6 tempest-VolumesBackupsTest-1849290619 None] Created volume successfully. May 02 10:34:58.754550 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:34:58.756101 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:34:58.863971 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:34:58.950158 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:35:04.539911 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-5d0697f7-f2c5-4449-9597-63bbcf23909a req-b12f1436-55d0-4c38-a54c-5011ca04d874 tempest-VolumesBackupsTest-1849290619 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:35:06.043772 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-5d0697f7-f2c5-4449-9597-63bbcf23909a req-b12f1436-55d0-4c38-a54c-5011ca04d874 tempest-VolumesBackupsTest-1849290619 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.504s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:35:06.044530 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-5d0697f7-f2c5-4449-9597-63bbcf23909a req-b12f1436-55d0-4c38-a54c-5011ca04d874 tempest-VolumesBackupsTest-1849290619 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c1451bbe-299e-4929-a8c1-a7b89b9e9f18', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'c1451bbe-299e-4929-a8c1-a7b89b9e9f18', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:35:06.181142 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-5d0697f7-f2c5-4449-9597-63bbcf23909a req-b12f1436-55d0-4c38-a54c-5011ca04d874 tempest-VolumesBackupsTest-1849290619 None] Connection info returned from driver {'name': 'volumes/volume-c1451bbe-299e-4929-a8c1-a7b89b9e9f18', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c1451bbe-299e-4929-a8c1-a7b89b9e9f18', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ad67116c-9491-4b7d-a332-de8288477942'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:35:06.343174 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-5d0697f7-f2c5-4449-9597-63bbcf23909a req-b12f1436-55d0-4c38-a54c-5011ca04d874 tempest-VolumesBackupsTest-1849290619 None] attachment_update completed successfully. May 02 10:35:09.943454 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-49504678-dedd-4f20-9b98-0e90813a8232 tempest-VolumesBackupsTest-1849290619 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-02T10:35:09Z,data_timestamp=2022-05-02T10:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-558585939',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=d14c165d-aab9-4c37-ab08-1b28760dea9b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='56a059bb653d412f81c66dfd5c50806c',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f70906b656804455a60b4be9f825869d',volume_id=c1451bbe-299e-4929-a8c1-a7b89b9e9f18) May 02 10:35:09.965209 ncdv-master-1 cinder-volume[123784]: INFO cinder.rpc [None req-49504678-dedd-4f20-9b98-0e90813a8232 tempest-VolumesBackupsTest-1849290619 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. May 02 10:35:09.974117 ncdv-master-1 cinder-volume[123784]: INFO cinder.rpc [None req-49504678-dedd-4f20-9b98-0e90813a8232 tempest-VolumesBackupsTest-1849290619 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. May 02 10:35:09.977287 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.backup.rpcapi [None req-49504678-dedd-4f20-9b98-0e90813a8232 tempest-VolumesBackupsTest-1849290619 None] continue_backup in rpcapi backup_id d14c165d-aab9-4c37-ab08-1b28760dea9b {{(pid=123784) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 02 10:35:13.817339 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:35:13.864569 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Flow 'volume_create_manager' (07cd6ef3-3523-4cc0-a8ca-efd2ae0217c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:35:13.872087 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7ea588-c34c-4112-aa70-dd783772ec2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:13.956255 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7ea588-c34c-4112-aa70-dd783772ec2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1715932806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8e013764-a0cb-41a8-8f5e-dde7380aee64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e2e106852b47f7a8e76aab24c5e883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:35:14Z,use_quota=True,user_id='11570d45e8de428fa751c85b80b673e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:13.983566 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d34628f-4060-4df2-b506-349f771abd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:13.987857 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d34628f-4060-4df2-b506-349f771abd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:14.007240 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3b08e9-7ce4-4fd5-9c84-2dd5dfdb22f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:14.178430 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3b08e9-7ce4-4fd5-9c84-2dd5dfdb22f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e013764-a0cb-41a8-8f5e-dde7380aee64', 'volume_name': 'volume-8e013764-a0cb-41a8-8f5e-dde7380aee64', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:14.183787 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7ca81c-7730-41b8-b1e8-48bc6207c64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:14.218191 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7ca81c-7730-41b8-b1e8-48bc6207c64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:14.227546 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2408ac94-a610-4995-9896-263adcbad2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:14.239613 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Volume 8e013764-a0cb-41a8-8f5e-dde7380aee64: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e013764-a0cb-41a8-8f5e-dde7380aee64', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:35:14.248688 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Cloning 8e013764-a0cb-41a8-8f5e-dde7380aee64 from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:35:14.267087 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:35:14.381514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 35, 14, 277943)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:35:14.382205 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:35:14.382766 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:35:14.392774 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.126s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:35:14.394477 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:35:14.408270 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 35, 14, 403041)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:35:14.408744 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:35:14.409309 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:35:14.432164 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:14.694744 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] creating snapshot='volume-8e013764-a0cb-41a8-8f5e-dde7380aee64.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:35:16.816107 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-8e013764-a0cb-41a8-8f5e-dde7380aee64.clone_snap' to 'volume-8e013764-a0cb-41a8-8f5e-dde7380aee64' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:35:16.822487 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-49504678-dedd-4f20-9b98-0e90813a8232 tempest-VolumesBackupsTest-1849290619 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:35:18.122791 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:35:18.125216 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:35:18.126228 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:35:18.563587 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:35:18.564672 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Marking volume 8e013764-a0cb-41a8-8f5e-dde7380aee64 as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:35:18.575096 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-49504678-dedd-4f20-9b98-0e90813a8232 tempest-VolumesBackupsTest-1849290619 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.753s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:35:18.576007 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-49504678-dedd-4f20-9b98-0e90813a8232 tempest-VolumesBackupsTest-1849290619 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c1451bbe-299e-4929-a8c1-a7b89b9e9f18', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'c1451bbe-299e-4929-a8c1-a7b89b9e9f18', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:35:18.605303 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-49504678-dedd-4f20-9b98-0e90813a8232 tempest-VolumesBackupsTest-1849290619 None] Initialize volume connection completed successfully. May 02 10:35:18.643901 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 8e013764-a0cb-41a8-8f5e-dde7380aee64. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:35:18.644340 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Creating volume glance metadata for volume 8e013764-a0cb-41a8-8f5e-dde7380aee64 backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:35:18.838422 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2408ac94-a610-4995-9896-263adcbad2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e013764-a0cb-41a8-8f5e-dde7380aee64', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:18.847160 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867dee93-5d01-4896-bac7-cbdefde707ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:18.977462 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Volume volume-8e013764-a0cb-41a8-8f5e-dde7380aee64 (8e013764-a0cb-41a8-8f5e-dde7380aee64): created successfully May 02 10:35:18.979555 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867dee93-5d01-4896-bac7-cbdefde707ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:18.992793 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Flow 'volume_create_manager' (07cd6ef3-3523-4cc0-a8ca-efd2ae0217c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:35:19.110636 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-d761fbf8-359e-4ee4-868b-bae0df885d7e tempest-TaggedBootDevicesTest_v242-1280307570 None] Created volume successfully. May 02 10:35:21.451800 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:35:21.512163 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Flow 'volume_create_manager' (f934f2f3-9206-4058-8999-fc711f2ec9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:35:21.512163 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e65f8e1-6316-4cfa-a95f-32af368a5288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:21.529988 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e65f8e1-6316-4cfa-a95f-32af368a5288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1600997431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=47a71972-8474-4868-a922-f7325b7b0812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e2e106852b47f7a8e76aab24c5e883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:35:21Z,use_quota=True,user_id='11570d45e8de428fa751c85b80b673e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:21.538294 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da121683-3a0d-44da-8a58-78e1a81e4a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:21.542967 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da121683-3a0d-44da-8a58-78e1a81e4a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:21.548672 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099bd083-7cef-48e7-9295-9308a7e1e6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:21.561077 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099bd083-7cef-48e7-9295-9308a7e1e6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a71972-8474-4868-a922-f7325b7b0812', 'volume_name': 'volume-47a71972-8474-4868-a922-f7325b7b0812', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:21.567492 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a51fcf-4cd6-467e-a35b-efe8739f2349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:21.572888 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a51fcf-4cd6-467e-a35b-efe8739f2349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:21.579233 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec3a1a1-f648-48d6-abe6-0b03caa5782b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:21.581180 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Volume 47a71972-8474-4868-a922-f7325b7b0812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a71972-8474-4868-a922-f7325b7b0812', 'volume_size': 1} May 02 10:35:21.581743 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] creating volume 'volume-47a71972-8474-4868-a922-f7325b7b0812' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:35:21.583207 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:22.602331 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:35:22.602901 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:35:22.606610 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec3a1a1-f648-48d6-abe6-0b03caa5782b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a71972-8474-4868-a922-f7325b7b0812', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:22.623600 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec10fef9-b284-445f-8d2b-923759550be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:22.681789 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Volume volume-47a71972-8474-4868-a922-f7325b7b0812 (47a71972-8474-4868-a922-f7325b7b0812): created successfully May 02 10:35:22.681789 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec10fef9-b284-445f-8d2b-923759550be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:22.691516 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Flow 'volume_create_manager' (f934f2f3-9206-4058-8999-fc711f2ec9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:35:22.785973 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-48d9474c-2f3f-45b9-83ed-c462e8614307 tempest-TaggedBootDevicesTest_v242-1280307570 None] Created volume successfully. May 02 10:35:24.455971 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:35:24.480886 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Flow 'volume_create_manager' (e89d54f1-fc08-4e2e-bad3-5776f8bf4a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:35:24.495320 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22caecc-875a-4205-8c92-4ce6795be21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:24.518254 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22caecc-875a-4205-8c92-4ce6795be21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-93327195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=487805c3-0b5f-4d4a-afbf-61da882ab5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e2e106852b47f7a8e76aab24c5e883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:35:24Z,use_quota=True,user_id='11570d45e8de428fa751c85b80b673e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:24.524616 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3960820-8d2f-4cd8-b1ea-efd97cb65ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:24.529549 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3960820-8d2f-4cd8-b1ea-efd97cb65ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:24.535026 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128edf89-6c83-43a6-b767-f10af827c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:24.539202 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128edf89-6c83-43a6-b767-f10af827c856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487805c3-0b5f-4d4a-afbf-61da882ab5ad', 'volume_name': 'volume-487805c3-0b5f-4d4a-afbf-61da882ab5ad', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:24.544625 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64995bb6-ace7-478c-b378-b42237f7fd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:24.549856 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64995bb6-ace7-478c-b378-b42237f7fd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:24.554999 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674fef66-0196-4a99-81de-23888ebc85b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:24.556468 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Volume 487805c3-0b5f-4d4a-afbf-61da882ab5ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487805c3-0b5f-4d4a-afbf-61da882ab5ad', 'volume_size': 1} May 02 10:35:24.557047 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] creating volume 'volume-487805c3-0b5f-4d4a-afbf-61da882ab5ad' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:35:24.562749 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:25.215503 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-cca05524-e5c5-4897-9857-298c0bed3094 tempest-ServersNegativeTestJSON-295755192 None] Lock "b'cinder-56d6d1d6-db11-4f6d-9169-b7f7ce248a1e-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:35:25.373380 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cca05524-e5c5-4897-9857-298c0bed3094 tempest-ServersNegativeTestJSON-295755192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:25.603074 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cca05524-e5c5-4897-9857-298c0bed3094 tempest-ServersNegativeTestJSON-295755192 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:35:25.604252 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cca05524-e5c5-4897-9857-298c0bed3094 tempest-ServersNegativeTestJSON-295755192 None] Volume volume-56d6d1d6-db11-4f6d-9169-b7f7ce248a1e is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:35:25.694829 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cca05524-e5c5-4897-9857-298c0bed3094 tempest-ServersNegativeTestJSON-295755192 None] deleting rbd volume volume-56d6d1d6-db11-4f6d-9169-b7f7ce248a1e {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:35:25.700238 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:35:25.700628 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:35:25.704528 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674fef66-0196-4a99-81de-23888ebc85b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487805c3-0b5f-4d4a-afbf-61da882ab5ad', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:25.722499 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981fa9fe-f9a5-4fdc-bf73-2461f58d00b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:25.763181 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Volume volume-487805c3-0b5f-4d4a-afbf-61da882ab5ad (487805c3-0b5f-4d4a-afbf-61da882ab5ad): created successfully May 02 10:35:25.769606 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981fa9fe-f9a5-4fdc-bf73-2461f58d00b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:25.776307 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Flow 'volume_create_manager' (e89d54f1-fc08-4e2e-bad3-5776f8bf4a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:35:25.849104 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4d772895-61d8-4698-84fc-671d6957340e tempest-TaggedBootDevicesTest_v242-1280307570 None] Created volume successfully. May 02 10:35:28.275096 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-49504678-dedd-4f20-9b98-0e90813a8232 tempest-VolumesBackupsTest-1849290619 None] Terminate volume connection completed successfully. May 02 10:35:28.294564 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-49504678-dedd-4f20-9b98-0e90813a8232 tempest-VolumesBackupsTest-1849290619 None] Remove volume export completed successfully. May 02 10:35:31.741883 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-cca05524-e5c5-4897-9857-298c0bed3094 tempest-ServersNegativeTestJSON-295755192 None] Created reservations ['4dbd6a05-e93d-4c04-b26e-b080a9591006', 'f1c04623-9770-4a32-b4f5-a2ce4e91e2cf', 'a2da439b-2caf-474a-a22a-38dcc0e41435', 'c60eef70-a2f8-4fc3-acb2-6db2b7e6790b'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:35:32.433937 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cca05524-e5c5-4897-9857-298c0bed3094 tempest-ServersNegativeTestJSON-295755192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:32.473539 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cca05524-e5c5-4897-9857-298c0bed3094 tempest-ServersNegativeTestJSON-295755192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:32.591787 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-cca05524-e5c5-4897-9857-298c0bed3094 tempest-ServersNegativeTestJSON-295755192 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:35:32.601061 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-cca05524-e5c5-4897-9857-298c0bed3094 tempest-ServersNegativeTestJSON-295755192 None] Deleted volume successfully. May 02 10:35:32.680168 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-cca05524-e5c5-4897-9857-298c0bed3094 tempest-ServersNegativeTestJSON-295755192 None] Lock "b'cinder-56d6d1d6-db11-4f6d-9169-b7f7ce248a1e-delete_volume'" released by "delete_volume" :: held 7.465s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:35:33.214700 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-bda78224-1e16-4319-8566-01ff8c48fb4b tempest-ServersNegativeTestJSON-295755192 None] Lock "b'cinder-61cb175e-8cd9-4a41-959a-4f22a937c7f1-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:35:33.387199 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bda78224-1e16-4319-8566-01ff8c48fb4b tempest-ServersNegativeTestJSON-295755192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:33.854670 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bda78224-1e16-4319-8566-01ff8c48fb4b tempest-ServersNegativeTestJSON-295755192 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:35:33.855067 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bda78224-1e16-4319-8566-01ff8c48fb4b tempest-ServersNegativeTestJSON-295755192 None] Volume volume-61cb175e-8cd9-4a41-959a-4f22a937c7f1 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:35:34.161246 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bda78224-1e16-4319-8566-01ff8c48fb4b tempest-ServersNegativeTestJSON-295755192 None] deleting rbd volume volume-61cb175e-8cd9-4a41-959a-4f22a937c7f1 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:35:40.872203 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-bda78224-1e16-4319-8566-01ff8c48fb4b tempest-ServersNegativeTestJSON-295755192 None] Created reservations ['a9c518d8-37a9-4a03-9afa-90c12c2d287c', 'be4b320d-b1b2-402b-be31-d2af41677016', '6ba5abb3-4020-4fe4-bbcb-e7a65f3eb24d', 'ee81011e-deb8-4182-b553-3d0f24221771'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:35:41.175679 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bda78224-1e16-4319-8566-01ff8c48fb4b tempest-ServersNegativeTestJSON-295755192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:41.260791 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bda78224-1e16-4319-8566-01ff8c48fb4b tempest-ServersNegativeTestJSON-295755192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:41.320860 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-bda78224-1e16-4319-8566-01ff8c48fb4b tempest-ServersNegativeTestJSON-295755192 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:35:41.336046 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-bda78224-1e16-4319-8566-01ff8c48fb4b tempest-ServersNegativeTestJSON-295755192 None] Deleted volume successfully. May 02 10:35:41.434739 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-bda78224-1e16-4319-8566-01ff8c48fb4b tempest-ServersNegativeTestJSON-295755192 None] Lock "b'cinder-61cb175e-8cd9-4a41-959a-4f22a937c7f1-delete_volume'" released by "delete_volume" :: held 8.220s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:35:44.335950 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-1bc609a2-2d2a-473c-b814-09be1fc7aa82 req-4e999de8-b605-4e66-8f29-dd0c12c89a9d tempest-VolumesBackupsTest-1849290619 None] Terminate volume connection completed successfully. May 02 10:35:44.336511 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-1bc609a2-2d2a-473c-b814-09be1fc7aa82 req-4e999de8-b605-4e66-8f29-dd0c12c89a9d tempest-VolumesBackupsTest-1849290619 None] Deleting attachment ad67116c-9491-4b7d-a332-de8288477942. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:35:46.301344 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-f3ff0b0a-a523-4751-a779-675c39bf1606 tempest-TaggedBootDevicesTest_v242-1280307570 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:35:47.083542 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-f3ff0b0a-a523-4751-a779-675c39bf1606 tempest-TaggedBootDevicesTest_v242-1280307570 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.781s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:35:47.085293 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-f3ff0b0a-a523-4751-a779-675c39bf1606 tempest-TaggedBootDevicesTest_v242-1280307570 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8e013764-a0cb-41a8-8f5e-dde7380aee64', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '8e013764-a0cb-41a8-8f5e-dde7380aee64', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:35:47.168568 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-f3ff0b0a-a523-4751-a779-675c39bf1606 tempest-TaggedBootDevicesTest_v242-1280307570 None] Connection info returned from driver {'name': 'volumes/volume-8e013764-a0cb-41a8-8f5e-dde7380aee64', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8e013764-a0cb-41a8-8f5e-dde7380aee64', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '425c2178-ae0d-426e-9899-b5005e4f0e00'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:35:47.322509 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-f3ff0b0a-a523-4751-a779-675c39bf1606 tempest-TaggedBootDevicesTest_v242-1280307570 None] attachment_update completed successfully. May 02 10:35:48.132367 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-70414556-80e3-4aac-a0da-9021eeda1bf2 tempest-TaggedBootDevicesTest_v242-1280307570 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:35:48.980176 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-70414556-80e3-4aac-a0da-9021eeda1bf2 tempest-TaggedBootDevicesTest_v242-1280307570 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.847s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:35:48.982472 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-70414556-80e3-4aac-a0da-9021eeda1bf2 tempest-TaggedBootDevicesTest_v242-1280307570 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-47a71972-8474-4868-a922-f7325b7b0812', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '47a71972-8474-4868-a922-f7325b7b0812', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:35:49.071965 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-70414556-80e3-4aac-a0da-9021eeda1bf2 tempest-TaggedBootDevicesTest_v242-1280307570 None] Connection info returned from driver {'name': 'volumes/volume-47a71972-8474-4868-a922-f7325b7b0812', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '47a71972-8474-4868-a922-f7325b7b0812', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4cd4b8cf-999f-45f8-a3e9-7e75b0465d8e'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:35:49.207460 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-70414556-80e3-4aac-a0da-9021eeda1bf2 tempest-TaggedBootDevicesTest_v242-1280307570 None] attachment_update completed successfully. May 02 10:35:49.961837 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-ffcecd98-6815-4e3c-aeaf-7207dbfd9801 tempest-TaggedBootDevicesTest_v242-1280307570 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:35:50.829896 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-ffcecd98-6815-4e3c-aeaf-7207dbfd9801 tempest-TaggedBootDevicesTest_v242-1280307570 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.870s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:35:50.831885 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-ffcecd98-6815-4e3c-aeaf-7207dbfd9801 tempest-TaggedBootDevicesTest_v242-1280307570 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-487805c3-0b5f-4d4a-afbf-61da882ab5ad', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '487805c3-0b5f-4d4a-afbf-61da882ab5ad', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:35:50.969469 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-ffcecd98-6815-4e3c-aeaf-7207dbfd9801 tempest-TaggedBootDevicesTest_v242-1280307570 None] Connection info returned from driver {'name': 'volumes/volume-487805c3-0b5f-4d4a-afbf-61da882ab5ad', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '487805c3-0b5f-4d4a-afbf-61da882ab5ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0c63e67b-ffe2-40ca-9c8a-fb8d28f0fe9c'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:35:51.130977 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-a8bcd9f2-2b8a-4b34-affe-3e5f095d586e req-ffcecd98-6815-4e3c-aeaf-7207dbfd9801 tempest-TaggedBootDevicesTest_v242-1280307570 None] attachment_update completed successfully. May 02 10:35:52.698098 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7ae52b90-d551-462b-b8c6-92f7ecfb96a0 tempest-VolumesBackupsTest-1849290619 None] Lock "b'cinder-c1451bbe-299e-4929-a8c1-a7b89b9e9f18-delete_volume'" acquired by "delete_volume" :: waited 0.054s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:35:52.814877 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7ae52b90-d551-462b-b8c6-92f7ecfb96a0 tempest-VolumesBackupsTest-1849290619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:54.655016 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7ae52b90-d551-462b-b8c6-92f7ecfb96a0 tempest-VolumesBackupsTest-1849290619 None] Volume volume-c1451bbe-299e-4929-a8c1-a7b89b9e9f18 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:35:55.084242 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7ae52b90-d551-462b-b8c6-92f7ecfb96a0 tempest-VolumesBackupsTest-1849290619 None] deleting rbd volume volume-c1451bbe-299e-4929-a8c1-a7b89b9e9f18 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:35:55.494965 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:35:55.530862 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Flow 'volume_create_manager' (6d956864-9677-41f8-9d80-8363cc88e665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:35:55.540316 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782e7c3f-acd0-4073-9ea6-1703f2f86581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:55.570186 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782e7c3f-acd0-4073-9ea6-1703f2f86581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1711919575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3ec5212e-a606-4f41-ab18-57576ff1e817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849913c996ea4611a4317bb4d0136031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:35:55Z,use_quota=True,user_id='aa1943e65db34e1da273b41c8a3d2faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:55.577790 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995cc0f1-99b0-4b0b-9aa7-3b6dbe8b98b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:55.584508 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995cc0f1-99b0-4b0b-9aa7-3b6dbe8b98b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:55.596758 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afcf919-ec67-42ce-a2ad-95c91c3b5412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:55.605966 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afcf919-ec67-42ce-a2ad-95c91c3b5412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec5212e-a606-4f41-ab18-57576ff1e817', 'volume_name': 'volume-3ec5212e-a606-4f41-ab18-57576ff1e817', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:55.619627 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d55b25-12c9-4a9a-8c8c-0e6ed3d8421e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:55.619627 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d55b25-12c9-4a9a-8c8c-0e6ed3d8421e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:55.624547 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3919398a-4954-4eff-b9a0-94781700ed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:55.628217 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Volume 3ec5212e-a606-4f41-ab18-57576ff1e817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec5212e-a606-4f41-ab18-57576ff1e817', 'volume_size': 1} May 02 10:35:55.632745 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] creating volume 'volume-3ec5212e-a606-4f41-ab18-57576ff1e817' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:35:55.634371 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:56.516004 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:35:56.516004 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:35:56.525409 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3919398a-4954-4eff-b9a0-94781700ed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec5212e-a606-4f41-ab18-57576ff1e817', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:56.538721 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad869a2a-0e37-43ad-8f1d-21b7ce9475ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:35:56.625322 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Volume volume-3ec5212e-a606-4f41-ab18-57576ff1e817 (3ec5212e-a606-4f41-ab18-57576ff1e817): created successfully May 02 10:35:56.629894 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad869a2a-0e37-43ad-8f1d-21b7ce9475ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:35:56.638269 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Flow 'volume_create_manager' (6d956864-9677-41f8-9d80-8363cc88e665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:35:56.700000 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-aba7890a-18f0-4f26-babd-bf62460a22d3 tempest-ServerRescueNegativeTestJSON-55061976 None] Created volume successfully. May 02 10:35:58.756227 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:35:58.757907 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:58.828033 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:58.891596 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:35:59.151163 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-7ae52b90-d551-462b-b8c6-92f7ecfb96a0 tempest-VolumesBackupsTest-1849290619 None] Created reservations ['459a21a6-f2b2-48db-8c60-c4209ae13d61', '727ffcb7-afb0-4bc1-94bf-76a6a875ce50', 'd77a93ed-5c09-4acf-afed-43e83274f4df', 'f14670f8-510b-4069-b7a0-ce61a1a4b8b9'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:35:59.403307 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7ae52b90-d551-462b-b8c6-92f7ecfb96a0 tempest-VolumesBackupsTest-1849290619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:59.449697 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7ae52b90-d551-462b-b8c6-92f7ecfb96a0 tempest-VolumesBackupsTest-1849290619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:35:59.505287 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-7ae52b90-d551-462b-b8c6-92f7ecfb96a0 tempest-VolumesBackupsTest-1849290619 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:35:59.526805 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-7ae52b90-d551-462b-b8c6-92f7ecfb96a0 tempest-VolumesBackupsTest-1849290619 None] Deleted volume successfully. May 02 10:35:59.597639 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7ae52b90-d551-462b-b8c6-92f7ecfb96a0 tempest-VolumesBackupsTest-1849290619 None] Lock "b'cinder-c1451bbe-299e-4929-a8c1-a7b89b9e9f18-delete_volume'" released by "delete_volume" :: held 6.900s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:36:01.709479 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:36:01.775511 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Flow 'volume_create_manager' (e0f1dc56-e8d0-474a-ba36-ef407f33c989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:36:01.811441 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c25ec21-b10c-43e2-b438-702cb92ccca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:01.878341 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c25ec21-b10c-43e2-b438-702cb92ccca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-357803427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6a607ad4-7820-465b-a861-f796c57fde8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56a059bb653d412f81c66dfd5c50806c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:36:02Z,use_quota=True,user_id='f70906b656804455a60b4be9f825869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:01.886642 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678b82ac-e4e8-4b01-841c-d2a2e41bbe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:01.892548 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678b82ac-e4e8-4b01-841c-d2a2e41bbe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:01.900142 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce19ff6-7c5b-499e-9f11-5559f06ded41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:02.059568 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce19ff6-7c5b-499e-9f11-5559f06ded41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a607ad4-7820-465b-a861-f796c57fde8c', 'volume_name': 'volume-6a607ad4-7820-465b-a861-f796c57fde8c', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:02.084106 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c020ff02-466b-4191-9567-f9890f15cd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:02.089797 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c020ff02-466b-4191-9567-f9890f15cd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:02.101062 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4948bec-aa4b-4631-8d30-8a3ce4f733a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:02.102532 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Volume 6a607ad4-7820-465b-a861-f796c57fde8c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a607ad4-7820-465b-a861-f796c57fde8c', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:36:02.103367 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Cloning 6a607ad4-7820-465b-a861-f796c57fde8c from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:36:02.123075 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:36:02.197639 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 36, 2, 138900)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:36:02.198207 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:36:02.198687 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:36:02.203606 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.081s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:36:02.204575 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:36:02.216569 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 36, 2, 213494)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:36:02.217039 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:36:02.217709 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:36:02.245200 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:02.430791 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] creating snapshot='volume-6a607ad4-7820-465b-a861-f796c57fde8c.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:36:04.538293 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-6a607ad4-7820-465b-a861-f796c57fde8c.clone_snap' to 'volume-6a607ad4-7820-465b-a861-f796c57fde8c' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:36:06.665684 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:36:06.667534 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:36:06.667979 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:36:07.413069 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:36:07.416654 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Marking volume 6a607ad4-7820-465b-a861-f796c57fde8c as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:36:07.550442 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 6a607ad4-7820-465b-a861-f796c57fde8c. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:36:07.550442 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Creating volume glance metadata for volume 6a607ad4-7820-465b-a861-f796c57fde8c backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:36:07.551548 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:36:07.581495 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Flow 'volume_create_manager' (623329f1-748a-405a-a2c1-21aca05ea50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:36:07.591590 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a1cca3-da62-4e69-95d0-47a70f64559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:07.634036 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a1cca3-da62-4e69-95d0-47a70f64559d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1581698901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=805fd218-6c67-4679-961d-939eaeded2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb85581362c41929cd74827f6654a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:36:07Z,use_quota=True,user_id='061ef885372742f0a9be8d967060ffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:07.649910 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469fe814-1613-40db-94cd-761af00cf0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:07.664844 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469fe814-1613-40db-94cd-761af00cf0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:07.675018 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fccaa1c-e6bf-40b2-b361-dc7643dd5e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:07.696320 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fccaa1c-e6bf-40b2-b361-dc7643dd5e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805fd218-6c67-4679-961d-939eaeded2a6', 'volume_name': 'volume-805fd218-6c67-4679-961d-939eaeded2a6', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:07.714595 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f044d298-08bf-4df0-9f92-d43bb38d775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:07.729335 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f044d298-08bf-4df0-9f92-d43bb38d775a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:07.732411 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03e15f4-be58-4527-98b3-d21ca6ca4d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:07.733815 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Volume 805fd218-6c67-4679-961d-939eaeded2a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805fd218-6c67-4679-961d-939eaeded2a6', 'volume_size': 1} May 02 10:36:07.734280 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] creating volume 'volume-805fd218-6c67-4679-961d-939eaeded2a6' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:36:07.735732 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:08.006589 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4948bec-aa4b-4631-8d30-8a3ce4f733a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a607ad4-7820-465b-a861-f796c57fde8c', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:08.011710 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409bd7ee-7312-471d-bc64-7ca8221a4313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:08.142269 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Volume volume-6a607ad4-7820-465b-a861-f796c57fde8c (6a607ad4-7820-465b-a861-f796c57fde8c): created successfully May 02 10:36:08.146103 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409bd7ee-7312-471d-bc64-7ca8221a4313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:08.153225 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Flow 'volume_create_manager' (e0f1dc56-e8d0-474a-ba36-ef407f33c989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:36:08.231225 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-7372baf3-0e8c-4773-abf8-d3fc0b586de2 tempest-VolumesBackupsTest-1849290619 None] Created volume successfully. May 02 10:36:08.976144 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:36:08.977368 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:36:08.982371 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03e15f4-be58-4527-98b3-d21ca6ca4d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805fd218-6c67-4679-961d-939eaeded2a6', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:08.993790 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d10c57-6fd0-4b25-a005-9164782adbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:09.080012 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Volume volume-805fd218-6c67-4679-961d-939eaeded2a6 (805fd218-6c67-4679-961d-939eaeded2a6): created successfully May 02 10:36:09.084730 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d10c57-6fd0-4b25-a005-9164782adbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:09.110896 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Flow 'volume_create_manager' (623329f1-748a-405a-a2c1-21aca05ea50a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:36:09.179641 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-c6adb70e-46ec-4208-ae0f-47f03d257a9a tempest-VolumeQuotasAdminTestJSON-841989222 None] Created volume successfully. May 02 10:36:09.603644 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-9263d22f-d751-4cc0-b89a-30d48b7af486 tempest-VolumeQuotasAdminTestJSON-841989222 None] Lock "b'cinder-805fd218-6c67-4679-961d-939eaeded2a6-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:36:09.742679 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9263d22f-d751-4cc0-b89a-30d48b7af486 tempest-VolumeQuotasAdminTestJSON-841989222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:10.156356 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9263d22f-d751-4cc0-b89a-30d48b7af486 tempest-VolumeQuotasAdminTestJSON-841989222 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:36:10.157776 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9263d22f-d751-4cc0-b89a-30d48b7af486 tempest-VolumeQuotasAdminTestJSON-841989222 None] Volume volume-805fd218-6c67-4679-961d-939eaeded2a6 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:36:10.441795 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9263d22f-d751-4cc0-b89a-30d48b7af486 tempest-VolumeQuotasAdminTestJSON-841989222 None] deleting rbd volume volume-805fd218-6c67-4679-961d-939eaeded2a6 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:36:10.460459 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-afb4635a-1eaf-4b63-88bf-e4e80a087043 tempest-VolumesBackupsTest-1849290619 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-02T10:36:09Z,data_timestamp=2022-05-02T10:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1368441604',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=85845315-21b0-4d0b-a72d-d7aad1728a0a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='56a059bb653d412f81c66dfd5c50806c',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f70906b656804455a60b4be9f825869d',volume_id=6a607ad4-7820-465b-a861-f796c57fde8c) May 02 10:36:10.461737 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.backup.rpcapi [None req-afb4635a-1eaf-4b63-88bf-e4e80a087043 tempest-VolumesBackupsTest-1849290619 None] continue_backup in rpcapi backup_id 85845315-21b0-4d0b-a72d-d7aad1728a0a {{(pid=123784) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 02 10:36:10.739925 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-afb4635a-1eaf-4b63-88bf-e4e80a087043 tempest-VolumesBackupsTest-1849290619 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:36:11.702374 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-afb4635a-1eaf-4b63-88bf-e4e80a087043 tempest-VolumesBackupsTest-1849290619 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.962s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:36:11.706041 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-afb4635a-1eaf-4b63-88bf-e4e80a087043 tempest-VolumesBackupsTest-1849290619 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6a607ad4-7820-465b-a861-f796c57fde8c', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '6a607ad4-7820-465b-a861-f796c57fde8c', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:36:11.728644 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-afb4635a-1eaf-4b63-88bf-e4e80a087043 tempest-VolumesBackupsTest-1849290619 None] Initialize volume connection completed successfully. May 02 10:36:19.745196 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-9263d22f-d751-4cc0-b89a-30d48b7af486 tempest-VolumeQuotasAdminTestJSON-841989222 None] Created reservations ['52ef45c2-d496-44e2-a3f2-74a8ef3f1502', 'd0c81249-c507-464e-a033-dca46d864a50', 'dc31b428-054c-416d-8e5c-3761414f4982', '2310e5b8-8372-41ef-9b54-5720d7cbe96f'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:36:20.031243 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9263d22f-d751-4cc0-b89a-30d48b7af486 tempest-VolumeQuotasAdminTestJSON-841989222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:20.083666 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9263d22f-d751-4cc0-b89a-30d48b7af486 tempest-VolumeQuotasAdminTestJSON-841989222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:20.147875 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-9263d22f-d751-4cc0-b89a-30d48b7af486 tempest-VolumeQuotasAdminTestJSON-841989222 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:36:20.153336 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-9263d22f-d751-4cc0-b89a-30d48b7af486 tempest-VolumeQuotasAdminTestJSON-841989222 None] Deleted volume successfully. May 02 10:36:20.240860 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-9263d22f-d751-4cc0-b89a-30d48b7af486 tempest-VolumeQuotasAdminTestJSON-841989222 None] Lock "b'cinder-805fd218-6c67-4679-961d-939eaeded2a6-delete_volume'" released by "delete_volume" :: held 10.637s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:36:21.576721 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:36:21.630475 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Flow 'volume_create_manager' (707bd076-d7d3-4bb1-a0e9-91dccb1d00de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:36:21.647115 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5959dd-5692-4dc5-99d4-847d7aeba237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:21.674506 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5959dd-5692-4dc5-99d4-847d7aeba237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1469763648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=24bbed7c-43bb-4fc3-a0e4-86bac18663f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb85581362c41929cd74827f6654a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:36:21Z,use_quota=True,user_id='061ef885372742f0a9be8d967060ffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:21.683121 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50dafa9-0eac-4b0f-ab9e-96134e74dcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:21.690598 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50dafa9-0eac-4b0f-ab9e-96134e74dcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:21.700329 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f102d34d-d178-4beb-b120-0fc4ac580db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:21.706901 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f102d34d-d178-4beb-b120-0fc4ac580db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24bbed7c-43bb-4fc3-a0e4-86bac18663f1', 'volume_name': 'volume-24bbed7c-43bb-4fc3-a0e4-86bac18663f1', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:21.717978 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4288eb5-5a45-402c-ac64-99fac86b7ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:21.723627 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4288eb5-5a45-402c-ac64-99fac86b7ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:21.732000 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24d8843-6fe1-4dc1-9e67-ec2d7efd3e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:21.734390 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Volume 24bbed7c-43bb-4fc3-a0e4-86bac18663f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24bbed7c-43bb-4fc3-a0e4-86bac18663f1', 'volume_size': 1} May 02 10:36:21.735438 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] creating volume 'volume-24bbed7c-43bb-4fc3-a0e4-86bac18663f1' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:36:21.737546 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:23.612329 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:36:23.613806 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:36:23.619556 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24d8843-6fe1-4dc1-9e67-ec2d7efd3e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24bbed7c-43bb-4fc3-a0e4-86bac18663f1', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:23.626650 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550571fd-e973-4fcf-be90-61fb58b9f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:23.716283 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Volume volume-24bbed7c-43bb-4fc3-a0e4-86bac18663f1 (24bbed7c-43bb-4fc3-a0e4-86bac18663f1): created successfully May 02 10:36:23.730765 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550571fd-e973-4fcf-be90-61fb58b9f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:23.733803 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Flow 'volume_create_manager' (707bd076-d7d3-4bb1-a0e9-91dccb1d00de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:36:23.847855 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-02f21212-f0ce-4191-86b9-ba708ad32d7f tempest-VolumeQuotasAdminTestJSON-841989222 None] Created volume successfully. May 02 10:36:26.096126 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b4dca3cf-2bf5-4bda-8c38-6595195fcf73 tempest-VolumeQuotasAdminTestJSON-2076993889 None] Transfer volume completed successfully. May 02 10:36:27.317993 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-aa99d05e-8064-4632-947b-1f122ab39f2c tempest-VolumeQuotasAdminTestJSON-765316039 None] Lock "b'cinder-24bbed7c-43bb-4fc3-a0e4-86bac18663f1-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:36:27.416592 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-aa99d05e-8064-4632-947b-1f122ab39f2c tempest-VolumeQuotasAdminTestJSON-765316039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:27.745776 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-aa99d05e-8064-4632-947b-1f122ab39f2c tempest-VolumeQuotasAdminTestJSON-765316039 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:36:27.746278 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-aa99d05e-8064-4632-947b-1f122ab39f2c tempest-VolumeQuotasAdminTestJSON-765316039 None] Volume volume-24bbed7c-43bb-4fc3-a0e4-86bac18663f1 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:36:28.170801 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-aa99d05e-8064-4632-947b-1f122ab39f2c tempest-VolumeQuotasAdminTestJSON-765316039 None] deleting rbd volume volume-24bbed7c-43bb-4fc3-a0e4-86bac18663f1 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:36:33.066072 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:36:33.086670 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Flow 'volume_create_manager' (d89b8f05-96e4-4f53-b0bb-2b088c65b2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:36:33.108963 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e576d84a-d8f4-488c-a3db-703698caa04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:33.127683 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e576d84a-d8f4-488c-a3db-703698caa04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2040842269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=797c071d-7bc2-466c-b6e2-a2f1160b8be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849913c996ea4611a4317bb4d0136031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:36:33Z,use_quota=True,user_id='aa1943e65db34e1da273b41c8a3d2faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:33.133411 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8a75c1-de22-4aa0-bcc6-a9fa33fd3030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:33.137679 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8a75c1-de22-4aa0-bcc6-a9fa33fd3030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:33.143523 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95fb04d-3d50-4cd2-aaec-105475a03f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:33.148012 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95fb04d-3d50-4cd2-aaec-105475a03f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '797c071d-7bc2-466c-b6e2-a2f1160b8be5', 'volume_name': 'volume-797c071d-7bc2-466c-b6e2-a2f1160b8be5', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:33.153067 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa40cc2d-0bad-422d-a905-01e34b814761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:33.157715 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa40cc2d-0bad-422d-a905-01e34b814761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:33.162481 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a570dd7-003d-4c85-aab2-5eee67c4cc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:33.163563 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Volume 797c071d-7bc2-466c-b6e2-a2f1160b8be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-797c071d-7bc2-466c-b6e2-a2f1160b8be5', 'volume_size': 1} May 02 10:36:33.163952 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] creating volume 'volume-797c071d-7bc2-466c-b6e2-a2f1160b8be5' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:36:33.164659 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:35.252847 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:36:35.254644 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:36:35.261020 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a570dd7-003d-4c85-aab2-5eee67c4cc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-797c071d-7bc2-466c-b6e2-a2f1160b8be5', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:35.268839 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd60c15-e781-4839-82c6-8b04b89d506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:35.368275 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Volume volume-797c071d-7bc2-466c-b6e2-a2f1160b8be5 (797c071d-7bc2-466c-b6e2-a2f1160b8be5): created successfully May 02 10:36:35.372784 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd60c15-e781-4839-82c6-8b04b89d506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:35.382109 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Flow 'volume_create_manager' (d89b8f05-96e4-4f53-b0bb-2b088c65b2fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:36:35.481879 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-0d5d270b-3ea8-432b-8c98-c5ca15888cbf tempest-ServerRescueNegativeTestJSON-55061976 None] Created volume successfully. May 02 10:36:41.733433 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-aa99d05e-8064-4632-947b-1f122ab39f2c tempest-VolumeQuotasAdminTestJSON-765316039 None] Created reservations ['8604b744-c057-42ff-a7de-4ef42f033087', '56d8dbe1-a6ac-478a-814a-62306b37fa87', '90b7a2e2-fd51-4610-a956-1ce364c30d21', '4a9f5fef-3b23-40db-9c12-cb86386739f1'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:36:41.997785 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-aa99d05e-8064-4632-947b-1f122ab39f2c tempest-VolumeQuotasAdminTestJSON-765316039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:42.075408 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-aa99d05e-8064-4632-947b-1f122ab39f2c tempest-VolumeQuotasAdminTestJSON-765316039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:42.125822 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-aa99d05e-8064-4632-947b-1f122ab39f2c tempest-VolumeQuotasAdminTestJSON-765316039 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:36:42.138971 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-aa99d05e-8064-4632-947b-1f122ab39f2c tempest-VolumeQuotasAdminTestJSON-765316039 None] Deleted volume successfully. May 02 10:36:42.270763 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-aa99d05e-8064-4632-947b-1f122ab39f2c tempest-VolumeQuotasAdminTestJSON-765316039 None] Lock "b'cinder-24bbed7c-43bb-4fc3-a0e4-86bac18663f1-delete_volume'" released by "delete_volume" :: held 14.953s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:36:56.998361 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:36:57.020640 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Flow 'volume_create_manager' (cafcdec9-cd05-49de-ad07-03d7be0e1132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:36:57.027918 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3928d87e-c5f9-4091-88c7-aaf24784943b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:57.051504 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3928d87e-c5f9-4091-88c7-aaf24784943b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1832306178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03354754-1f41-452e-8c56-f75705838ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1e0a81898b455dbad1377adec39dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:36:57Z,use_quota=True,user_id='f176aec4c2664ef0bb5a02a7cd27a6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:57.058203 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aff0b8f-25aa-4c76-b304-34888d9f04c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:57.063736 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aff0b8f-25aa-4c76-b304-34888d9f04c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:57.072715 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05edd423-f21d-48d2-9497-427c4101ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:57.080848 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05edd423-f21d-48d2-9497-427c4101ae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03354754-1f41-452e-8c56-f75705838ff8', 'volume_name': 'volume-03354754-1f41-452e-8c56-f75705838ff8', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:57.086428 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7e8f3e-8bf9-4ea6-a941-7a3fd6acd873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:57.091284 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7e8f3e-8bf9-4ea6-a941-7a3fd6acd873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:57.097890 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70265944-d9f5-4d91-9af7-28f776be0148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:57.099066 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Volume 03354754-1f41-452e-8c56-f75705838ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03354754-1f41-452e-8c56-f75705838ff8', 'volume_size': 1} May 02 10:36:57.099764 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] creating volume 'volume-03354754-1f41-452e-8c56-f75705838ff8' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:36:57.101683 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:58.761135 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:36:58.763783 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:58.809770 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:36:58.853456 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:36:59.549410 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:36:59.549795 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:36:59.553604 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70265944-d9f5-4d91-9af7-28f776be0148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03354754-1f41-452e-8c56-f75705838ff8', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:59.558483 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ac3e4a-6eef-4335-a2d0-d611dc52d78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:36:59.671051 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Volume volume-03354754-1f41-452e-8c56-f75705838ff8 (03354754-1f41-452e-8c56-f75705838ff8): created successfully May 02 10:36:59.674647 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ac3e4a-6eef-4335-a2d0-d611dc52d78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:36:59.680300 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Flow 'volume_create_manager' (cafcdec9-cd05-49de-ad07-03d7be0e1132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:36:59.823885 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-bbe2c256-4738-4c97-af75-b104b27381b1 tempest-AbsoluteLimitsTests-1403825700 None] Created volume successfully. May 02 10:37:00.211726 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-5616b51e-91c6-4fd7-8a5b-5071baf9eeb7 tempest-AbsoluteLimitsTests-1403825700 None] Lock "b'cinder-03354754-1f41-452e-8c56-f75705838ff8-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:37:00.332841 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5616b51e-91c6-4fd7-8a5b-5071baf9eeb7 tempest-AbsoluteLimitsTests-1403825700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:01.510708 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5616b51e-91c6-4fd7-8a5b-5071baf9eeb7 tempest-AbsoluteLimitsTests-1403825700 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:37:01.511534 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5616b51e-91c6-4fd7-8a5b-5071baf9eeb7 tempest-AbsoluteLimitsTests-1403825700 None] Volume volume-03354754-1f41-452e-8c56-f75705838ff8 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:37:02.030210 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5616b51e-91c6-4fd7-8a5b-5071baf9eeb7 tempest-AbsoluteLimitsTests-1403825700 None] deleting rbd volume volume-03354754-1f41-452e-8c56-f75705838ff8 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:37:07.709254 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:37:07.737009 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Flow 'volume_create_manager' (50f73796-1679-4070-bd9f-eefa4fdc79c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:07.743718 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0cf84e0-8ec8-4a43-aa00-14c6e6b49001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:07.759816 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0cf84e0-8ec8-4a43-aa00-14c6e6b49001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-938960794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=97637766-7b36-42d5-a8e1-ba53a0c0720f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='538f234d5ed04b63bcc853995b600847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:37:07Z,use_quota=True,user_id='4a43413a459e451fb05f9dc9e8bd1d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:07.765793 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd8e049-8dec-469c-9706-971b55adeb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:07.770058 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd8e049-8dec-469c-9706-971b55adeb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:07.775341 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddec792-f786-438b-964e-37bf7e457f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:07.780039 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddec792-f786-438b-964e-37bf7e457f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97637766-7b36-42d5-a8e1-ba53a0c0720f', 'volume_name': 'volume-97637766-7b36-42d5-a8e1-ba53a0c0720f', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:07.785105 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb34f1cb-9014-44eb-b35e-8ea27a093a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:07.789272 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb34f1cb-9014-44eb-b35e-8ea27a093a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:07.794115 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6870345c-d025-444d-81d3-36cd9bc639e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:07.795727 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Volume 97637766-7b36-42d5-a8e1-ba53a0c0720f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97637766-7b36-42d5-a8e1-ba53a0c0720f', 'volume_size': 1} May 02 10:37:07.796126 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] creating volume 'volume-97637766-7b36-42d5-a8e1-ba53a0c0720f' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:37:07.796826 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:09.581178 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:37:09.581869 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:37:09.585373 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6870345c-d025-444d-81d3-36cd9bc639e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97637766-7b36-42d5-a8e1-ba53a0c0720f', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:09.590023 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77382d6d-dc5c-455a-83d9-0ad72384abde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:09.654979 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Volume volume-97637766-7b36-42d5-a8e1-ba53a0c0720f (97637766-7b36-42d5-a8e1-ba53a0c0720f): created successfully May 02 10:37:09.659250 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77382d6d-dc5c-455a-83d9-0ad72384abde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:09.681405 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Flow 'volume_create_manager' (50f73796-1679-4070-bd9f-eefa4fdc79c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:09.766550 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-e0dfcdb3-edba-4c9b-b7ea-8e6ecaf80b10 req-92cfac91-e59a-41fc-9431-b36e3c7f3cfe tempest-VolumesGetTestJSON-767827030 None] Created volume successfully. May 02 10:37:10.815582 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-2f7bb68e-2735-460a-bd9c-db4345dcc594 req-30c39e0e-cd77-436f-8531-14884988b06a tempest-VolumesGetTestJSON-767827030 None] Lock "b'cinder-97637766-7b36-42d5-a8e1-ba53a0c0720f-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:37:10.893744 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-2f7bb68e-2735-460a-bd9c-db4345dcc594 req-30c39e0e-cd77-436f-8531-14884988b06a tempest-VolumesGetTestJSON-767827030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:11.410980 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-2f7bb68e-2735-460a-bd9c-db4345dcc594 req-30c39e0e-cd77-436f-8531-14884988b06a tempest-VolumesGetTestJSON-767827030 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:37:11.411425 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-2f7bb68e-2735-460a-bd9c-db4345dcc594 req-30c39e0e-cd77-436f-8531-14884988b06a tempest-VolumesGetTestJSON-767827030 None] Volume volume-97637766-7b36-42d5-a8e1-ba53a0c0720f is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:37:11.767105 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-2f7bb68e-2735-460a-bd9c-db4345dcc594 req-30c39e0e-cd77-436f-8531-14884988b06a tempest-VolumesGetTestJSON-767827030 None] deleting rbd volume volume-97637766-7b36-42d5-a8e1-ba53a0c0720f {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:37:12.384010 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-5616b51e-91c6-4fd7-8a5b-5071baf9eeb7 tempest-AbsoluteLimitsTests-1403825700 None] Created reservations ['9d3e2f21-9f77-4753-80c8-29aea6dff246', '4544f5fd-6c67-46c2-959d-865050c0f29f', 'fb044c2c-686f-4615-aca2-00178ab76de0', '90f024a1-6525-42aa-a3d8-47224372c6ee'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:37:12.544284 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5616b51e-91c6-4fd7-8a5b-5071baf9eeb7 tempest-AbsoluteLimitsTests-1403825700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:12.599953 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5616b51e-91c6-4fd7-8a5b-5071baf9eeb7 tempest-AbsoluteLimitsTests-1403825700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:12.645548 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-5616b51e-91c6-4fd7-8a5b-5071baf9eeb7 tempest-AbsoluteLimitsTests-1403825700 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:37:12.655994 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5616b51e-91c6-4fd7-8a5b-5071baf9eeb7 tempest-AbsoluteLimitsTests-1403825700 None] Deleted volume successfully. May 02 10:37:12.796759 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-5616b51e-91c6-4fd7-8a5b-5071baf9eeb7 tempest-AbsoluteLimitsTests-1403825700 None] Lock "b'cinder-03354754-1f41-452e-8c56-f75705838ff8-delete_volume'" released by "delete_volume" :: held 12.579s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:37:14.177282 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-afb4635a-1eaf-4b63-88bf-e4e80a087043 tempest-VolumesBackupsTest-1849290619 None] Terminate volume connection completed successfully. May 02 10:37:14.196791 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-afb4635a-1eaf-4b63-88bf-e4e80a087043 tempest-VolumesBackupsTest-1849290619 None] Remove volume export completed successfully. May 02 10:37:15.890314 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:37:15.910710 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Flow 'volume_create_manager' (fdca2d2c-3ef2-43d0-b43d-69854279a931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:15.917273 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aaec086-7628-4ad7-945a-6b2c90ec3fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:15.945518 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aaec086-7628-4ad7-945a-6b2c90ec3fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:37:15Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_85845315-21b0-4d0b-a72d-d7aad1728a0a',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56a059bb653d412f81c66dfd5c50806c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:37:16Z,use_quota=True,user_id='f70906b656804455a60b4be9f825869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:15.952584 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9221fd09-136a-484b-bf32-0ae9f3d034df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:15.959970 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9221fd09-136a-484b-bf32-0ae9f3d034df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:15.965166 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9489032-81d1-404c-a118-050c80236bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:15.969418 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9489032-81d1-404c-a118-050c80236bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a', 'volume_name': 'volume-ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:15.974305 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b5e629-974a-480c-aa6f-f178762e11ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:15.978260 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b5e629-974a-480c-aa6f-f178762e11ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:15.985663 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab608c3f-6914-4469-ae42-b0f9260174a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:15.986807 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Volume ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a', 'volume_size': 1} May 02 10:37:15.987203 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] creating volume 'volume-ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:37:15.988004 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:17.250993 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:37:17.255159 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:37:17.255159 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab608c3f-6914-4469-ae42-b0f9260174a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:17.259753 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c1934b-e89a-497d-96e6-41794183674e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:17.384344 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Volume volume-ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a (ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a): created successfully May 02 10:37:17.390777 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c1934b-e89a-497d-96e6-41794183674e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:17.396896 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Flow 'volume_create_manager' (fdca2d2c-3ef2-43d0-b43d-69854279a931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:17.475168 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Created volume successfully. May 02 10:37:17.915049 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:37:18.733064 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.817s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:37:18.734595 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:37:18.761885 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Initialize volume connection completed successfully. May 02 10:37:19.829510 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:37:19.859084 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Flow 'volume_create_manager' (a7de53ae-dcba-476d-8003-09a5587a6a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:19.866575 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cad4c9b-05fd-4479-995b-db8ee6b9e1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:19.884241 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cad4c9b-05fd-4479-995b-db8ee6b9e1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1671773376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6e2b59c5-c520-4b55-a8f6-471e5b455a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a41b924ad64c92920208d7b63a8910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:37:20Z,use_quota=True,user_id='0d746eb0b3b248a48fde2b7df0d8c9bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:19.896945 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3419c7-3817-4e6c-a276-e9df03d9683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:19.902701 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3419c7-3817-4e6c-a276-e9df03d9683f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:19.909165 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac267d84-7eb7-4ba8-a505-b80e58333afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:19.913214 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac267d84-7eb7-4ba8-a505-b80e58333afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e2b59c5-c520-4b55-a8f6-471e5b455a23', 'volume_name': 'volume-6e2b59c5-c520-4b55-a8f6-471e5b455a23', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:19.918121 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec04f43c-2e5d-4382-a678-f31d8e77f2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:19.922983 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec04f43c-2e5d-4382-a678-f31d8e77f2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:19.927818 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017bfb23-b9d4-4c01-9b0a-95226504f7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:19.929022 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Volume 6e2b59c5-c520-4b55-a8f6-471e5b455a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e2b59c5-c520-4b55-a8f6-471e5b455a23', 'volume_size': 1} May 02 10:37:19.929437 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] creating volume 'volume-6e2b59c5-c520-4b55-a8f6-471e5b455a23' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:37:19.930394 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:20.131162 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [req-2f7bb68e-2735-460a-bd9c-db4345dcc594 req-30c39e0e-cd77-436f-8531-14884988b06a tempest-VolumesGetTestJSON-767827030 None] Created reservations ['edacd909-e5a2-4fc9-80f8-c05aa7f21993', 'd132b435-d147-49f4-9092-4ec01845749f', '996ba43c-e73e-43cc-9659-a5bfe1120aa6', 'b687fd35-5b9f-490a-88a2-c08438353bbd'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:37:20.327334 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-2f7bb68e-2735-460a-bd9c-db4345dcc594 req-30c39e0e-cd77-436f-8531-14884988b06a tempest-VolumesGetTestJSON-767827030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:20.352287 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-2f7bb68e-2735-460a-bd9c-db4345dcc594 req-30c39e0e-cd77-436f-8531-14884988b06a tempest-VolumesGetTestJSON-767827030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:20.375900 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [req-2f7bb68e-2735-460a-bd9c-db4345dcc594 req-30c39e0e-cd77-436f-8531-14884988b06a tempest-VolumesGetTestJSON-767827030 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:37:20.381458 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-2f7bb68e-2735-460a-bd9c-db4345dcc594 req-30c39e0e-cd77-436f-8531-14884988b06a tempest-VolumesGetTestJSON-767827030 None] Deleted volume successfully. May 02 10:37:20.457587 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-2f7bb68e-2735-460a-bd9c-db4345dcc594 req-30c39e0e-cd77-436f-8531-14884988b06a tempest-VolumesGetTestJSON-767827030 None] Lock "b'cinder-97637766-7b36-42d5-a8e1-ba53a0c0720f-delete_volume'" released by "delete_volume" :: held 9.642s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:37:21.205128 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:37:21.205679 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:37:21.213626 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017bfb23-b9d4-4c01-9b0a-95226504f7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e2b59c5-c520-4b55-a8f6-471e5b455a23', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:21.220474 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646bfe88-9c99-4c42-a7d7-82f361cc3574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:21.291860 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Volume volume-6e2b59c5-c520-4b55-a8f6-471e5b455a23 (6e2b59c5-c520-4b55-a8f6-471e5b455a23): created successfully May 02 10:37:21.296100 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646bfe88-9c99-4c42-a7d7-82f361cc3574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:21.301939 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Flow 'volume_create_manager' (a7de53ae-dcba-476d-8003-09a5587a6a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:21.423477 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-1e563076-ba19-406a-919e-4023d407bafb tempest-VolumesTransfersV355Test-186378683 None] Created volume successfully. May 02 10:37:23.229237 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-02e756e8-86de-4b31-b25c-0d5d5343fb41 tempest-VolumesTransfersV355Test-692114264 None] Transfer volume completed successfully. May 02 10:37:24.508622 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-8ffd8c6e-e9ee-4c43-927c-04106b8c3016 tempest-VolumesTransfersV355Test-756271995 None] Lock "b'cinder-6e2b59c5-c520-4b55-a8f6-471e5b455a23-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:37:24.522315 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:37:24.542131 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Flow 'volume_create_manager' (bc27397b-4dce-4ede-81dd-a4a07b141378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:24.548784 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155b7ba7-a41b-4f7d-b606-3d5bb078a3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:24.565548 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155b7ba7-a41b-4f7d-b606-3d5bb078a3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1868076398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=79625573-a796-47b9-a8d2-5b8707c6748d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='28b3733aca9542b3a9d873766a883fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:37:24Z,use_quota=True,user_id='1b9118b995654db585d0f47f4e97475c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:24.570604 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cde766-ced0-45f1-a2e5-b49717ca85b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:24.574733 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cde766-ced0-45f1-a2e5-b49717ca85b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:24.580476 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220655ae-7ba4-45cf-aa1f-9cd382bfa800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:24.584527 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220655ae-7ba4-45cf-aa1f-9cd382bfa800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79625573-a796-47b9-a8d2-5b8707c6748d', 'volume_name': 'volume-79625573-a796-47b9-a8d2-5b8707c6748d', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:24.593278 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae2ebc6-6207-4087-b195-b7e6642ac46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:24.593394 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae2ebc6-6207-4087-b195-b7e6642ac46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:24.598119 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a9db82-6b41-46aa-9334-64de0aadaac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:24.599186 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Volume 79625573-a796-47b9-a8d2-5b8707c6748d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79625573-a796-47b9-a8d2-5b8707c6748d', 'volume_size': 1} May 02 10:37:24.599580 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] creating volume 'volume-79625573-a796-47b9-a8d2-5b8707c6748d' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:37:24.600365 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:24.636775 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8ffd8c6e-e9ee-4c43-927c-04106b8c3016 tempest-VolumesTransfersV355Test-756271995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:25.007854 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8ffd8c6e-e9ee-4c43-927c-04106b8c3016 tempest-VolumesTransfersV355Test-756271995 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:37:25.008609 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8ffd8c6e-e9ee-4c43-927c-04106b8c3016 tempest-VolumesTransfersV355Test-756271995 None] Volume volume-6e2b59c5-c520-4b55-a8f6-471e5b455a23 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:37:25.502840 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8ffd8c6e-e9ee-4c43-927c-04106b8c3016 tempest-VolumesTransfersV355Test-756271995 None] deleting rbd volume volume-6e2b59c5-c520-4b55-a8f6-471e5b455a23 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:37:26.675189 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:37:26.675825 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:37:26.684504 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a9db82-6b41-46aa-9334-64de0aadaac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79625573-a796-47b9-a8d2-5b8707c6748d', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:26.690061 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931ac789-c7be-4da2-a9b4-12eb62eb1702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:26.812550 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Volume volume-79625573-a796-47b9-a8d2-5b8707c6748d (79625573-a796-47b9-a8d2-5b8707c6748d): created successfully May 02 10:37:26.817930 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931ac789-c7be-4da2-a9b4-12eb62eb1702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:26.822227 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Flow 'volume_create_manager' (bc27397b-4dce-4ede-81dd-a4a07b141378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:27.109645 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-24a147d1-836f-44ee-a018-271a9940adad tempest-VolumesTestJSON-272218658 None] Created volume successfully. May 02 10:37:28.368255 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:37:28.391688 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Flow 'volume_create_manager' (aa6eb538-232d-4d7b-8a32-fa9930cf0277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:28.398168 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b261a7-cb89-4724-963e-70fd4d8b8e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:28.415101 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b261a7-cb89-4724-963e-70fd4d8b8e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-139182185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a7ab99c0-b861-4b50-9374-5147604650c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='28b3733aca9542b3a9d873766a883fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:37:28Z,use_quota=True,user_id='1b9118b995654db585d0f47f4e97475c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:28.421188 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71adad5-c4ff-4066-8915-4e9bab5cd4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:28.425385 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71adad5-c4ff-4066-8915-4e9bab5cd4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:28.430544 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736f2f15-8d36-4483-8e01-a87b1d952cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:28.434621 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736f2f15-8d36-4483-8e01-a87b1d952cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ab99c0-b861-4b50-9374-5147604650c2', 'volume_name': 'volume-a7ab99c0-b861-4b50-9374-5147604650c2', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:28.439595 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5b76e6-bb64-49b6-93bd-63c29707d84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:28.443517 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5b76e6-bb64-49b6-93bd-63c29707d84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:28.448281 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972c0a54-2e29-419e-85ff-822fe2cdc7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:28.449381 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Volume a7ab99c0-b861-4b50-9374-5147604650c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ab99c0-b861-4b50-9374-5147604650c2', 'volume_size': 1} May 02 10:37:28.449771 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] creating volume 'volume-a7ab99c0-b861-4b50-9374-5147604650c2' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:37:28.450436 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:30.577889 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:37:30.578426 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:37:30.582094 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972c0a54-2e29-419e-85ff-822fe2cdc7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ab99c0-b861-4b50-9374-5147604650c2', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:30.587185 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a11b58-e39b-42a5-83d0-f4486bc905ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:30.691615 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Volume volume-a7ab99c0-b861-4b50-9374-5147604650c2 (a7ab99c0-b861-4b50-9374-5147604650c2): created successfully May 02 10:37:30.695929 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a11b58-e39b-42a5-83d0-f4486bc905ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:30.702193 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Flow 'volume_create_manager' (aa6eb538-232d-4d7b-8a32-fa9930cf0277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:30.783915 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-34a8c5a5-b8d2-465a-bd3f-3dd2191eeee3 tempest-VolumesTestJSON-272218658 None] Created volume successfully. May 02 10:37:32.294136 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:37:32.316741 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Flow 'volume_create_manager' (7ef5f7f2-7f0d-4f91-a7f8-44b6a9771e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:32.323897 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1414842d-bbaf-4064-8a76-3b749d6c7a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:32.342736 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1414842d-bbaf-4064-8a76-3b749d6c7a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-245607411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=840641f6-86d9-41a1-83a4-98a4c81b447a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='28b3733aca9542b3a9d873766a883fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:37:32Z,use_quota=True,user_id='1b9118b995654db585d0f47f4e97475c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:32.348671 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f917240-70d2-47f3-9a08-450e2bae6714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:32.355008 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f917240-70d2-47f3-9a08-450e2bae6714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:32.358717 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cc5e82-0917-49be-bb70-a236e8e5fea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:32.363035 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cc5e82-0917-49be-bb70-a236e8e5fea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '840641f6-86d9-41a1-83a4-98a4c81b447a', 'volume_name': 'volume-840641f6-86d9-41a1-83a4-98a4c81b447a', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:32.368139 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a19d6e9-490f-48ef-b78d-0b6c7b6cc8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:32.374833 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a19d6e9-490f-48ef-b78d-0b6c7b6cc8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:32.380561 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1145448-d765-470d-81e0-d467d29781b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:32.383573 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Volume 840641f6-86d9-41a1-83a4-98a4c81b447a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-840641f6-86d9-41a1-83a4-98a4c81b447a', 'volume_size': 1} May 02 10:37:32.383573 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] creating volume 'volume-840641f6-86d9-41a1-83a4-98a4c81b447a' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:37:32.383573 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:34.876737 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:37:34.877425 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:37:34.880851 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1145448-d765-470d-81e0-d467d29781b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-840641f6-86d9-41a1-83a4-98a4c81b447a', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:34.885602 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f698cec-5e7b-4022-8b61-ce5cd925e855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:35.051954 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Volume volume-840641f6-86d9-41a1-83a4-98a4c81b447a (840641f6-86d9-41a1-83a4-98a4c81b447a): created successfully May 02 10:37:35.055676 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f698cec-5e7b-4022-8b61-ce5cd925e855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:35.062228 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Flow 'volume_create_manager' (7ef5f7f2-7f0d-4f91-a7f8-44b6a9771e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:35.207522 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-d8ec0728-807c-42fb-994b-097be9ee7fa8 tempest-VolumesTestJSON-272218658 None] Created volume successfully. May 02 10:37:36.428283 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-981f9b81-e7b0-488b-a784-4c42a4840968 tempest-VolumesTestJSON-272218658 None] Lock "b'cinder-840641f6-86d9-41a1-83a4-98a4c81b447a-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:37:36.579562 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-981f9b81-e7b0-488b-a784-4c42a4840968 tempest-VolumesTestJSON-272218658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:37.142986 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-981f9b81-e7b0-488b-a784-4c42a4840968 tempest-VolumesTestJSON-272218658 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:37:37.143421 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-981f9b81-e7b0-488b-a784-4c42a4840968 tempest-VolumesTestJSON-272218658 None] Volume volume-840641f6-86d9-41a1-83a4-98a4c81b447a is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:37:37.526508 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-981f9b81-e7b0-488b-a784-4c42a4840968 tempest-VolumesTestJSON-272218658 None] deleting rbd volume volume-840641f6-86d9-41a1-83a4-98a4c81b447a {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:37:37.779793 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-ecd737f9-6a12-4e91-b297-c493bd8e9d25 req-0f6b47b0-2da3-453a-94c8-e202434f7999 tempest-ServerRescueNegativeTestJSON-55061976 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:37:38.590188 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-ecd737f9-6a12-4e91-b297-c493bd8e9d25 req-0f6b47b0-2da3-453a-94c8-e202434f7999 tempest-ServerRescueNegativeTestJSON-55061976 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.810s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:37:38.591042 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-ecd737f9-6a12-4e91-b297-c493bd8e9d25 req-0f6b47b0-2da3-453a-94c8-e202434f7999 tempest-ServerRescueNegativeTestJSON-55061976 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-797c071d-7bc2-466c-b6e2-a2f1160b8be5', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '797c071d-7bc2-466c-b6e2-a2f1160b8be5', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:37:38.704129 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-ecd737f9-6a12-4e91-b297-c493bd8e9d25 req-0f6b47b0-2da3-453a-94c8-e202434f7999 tempest-ServerRescueNegativeTestJSON-55061976 None] Connection info returned from driver {'name': 'volumes/volume-797c071d-7bc2-466c-b6e2-a2f1160b8be5', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '797c071d-7bc2-466c-b6e2-a2f1160b8be5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd6014f46-7a0d-41ee-b6dd-c52ad478e8bd'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:37:38.846685 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-ecd737f9-6a12-4e91-b297-c493bd8e9d25 req-0f6b47b0-2da3-453a-94c8-e202434f7999 tempest-ServerRescueNegativeTestJSON-55061976 None] attachment_update completed successfully. May 02 10:37:40.509156 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-8ffd8c6e-e9ee-4c43-927c-04106b8c3016 tempest-VolumesTransfersV355Test-756271995 None] Created reservations ['94800a72-6b11-41a0-8dce-ab7d4bc3a1f3', '1a447377-068c-4ed7-8089-a5dbebd90d50', '54be3dd0-3f4c-4be3-afb8-e95fc421b179', '67ac7772-2443-46dd-90e0-5f07acbc3dcc'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:37:40.789548 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8ffd8c6e-e9ee-4c43-927c-04106b8c3016 tempest-VolumesTransfersV355Test-756271995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:40.972023 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8ffd8c6e-e9ee-4c43-927c-04106b8c3016 tempest-VolumesTransfersV355Test-756271995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:41.006543 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-8ffd8c6e-e9ee-4c43-927c-04106b8c3016 tempest-VolumesTransfersV355Test-756271995 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:37:41.011305 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-8ffd8c6e-e9ee-4c43-927c-04106b8c3016 tempest-VolumesTransfersV355Test-756271995 None] Deleted volume successfully. May 02 10:37:41.114326 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-8ffd8c6e-e9ee-4c43-927c-04106b8c3016 tempest-VolumesTransfersV355Test-756271995 None] Lock "b'cinder-6e2b59c5-c520-4b55-a8f6-471e5b455a23-delete_volume'" released by "delete_volume" :: held 16.606s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:37:42.476431 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:37:42.497529 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Flow 'volume_create_manager' (1d56246b-01e1-443b-9afb-27e380134c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:42.504906 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc1a932-7d3a-419b-b05e-3c838dd147cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:42.523051 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc1a932-7d3a-419b-b05e-3c838dd147cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1975831260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3e653f23-5d6f-49af-8223-8dd79ec80cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a41b924ad64c92920208d7b63a8910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:37:42Z,use_quota=True,user_id='0d746eb0b3b248a48fde2b7df0d8c9bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:42.528444 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b294fde-77d7-4f53-8d1c-01af1dfb1c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:42.533284 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b294fde-77d7-4f53-8d1c-01af1dfb1c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:42.538485 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc72def-b75f-4e7c-b148-e3cfd82b4e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:42.544641 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc72def-b75f-4e7c-b148-e3cfd82b4e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e653f23-5d6f-49af-8223-8dd79ec80cf4', 'volume_name': 'volume-3e653f23-5d6f-49af-8223-8dd79ec80cf4', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:42.556248 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5435a8e-45cc-4581-8f09-867be7967098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:42.565852 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5435a8e-45cc-4581-8f09-867be7967098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:42.567692 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e029dfb-58ee-4a3d-a4f7-21e9124fa02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:42.568828 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Volume 3e653f23-5d6f-49af-8223-8dd79ec80cf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e653f23-5d6f-49af-8223-8dd79ec80cf4', 'volume_size': 1} May 02 10:37:42.569238 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] creating volume 'volume-3e653f23-5d6f-49af-8223-8dd79ec80cf4' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:37:42.570065 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:44.021976 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:37:44.023103 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:37:44.028189 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e029dfb-58ee-4a3d-a4f7-21e9124fa02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e653f23-5d6f-49af-8223-8dd79ec80cf4', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:44.033567 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1f1a95-78a9-42c7-8f4f-11d6d08037a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:37:44.131625 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Volume volume-3e653f23-5d6f-49af-8223-8dd79ec80cf4 (3e653f23-5d6f-49af-8223-8dd79ec80cf4): created successfully May 02 10:37:44.135263 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1f1a95-78a9-42c7-8f4f-11d6d08037a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:37:44.140810 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Flow 'volume_create_manager' (1d56246b-01e1-443b-9afb-27e380134c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:37:44.218375 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-00c0dbcf-7d1b-416a-a794-cd0fa47f1ee3 tempest-VolumesTransfersV355Test-186378683 None] Created volume successfully. May 02 10:37:45.201681 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-1f8a12a3-d8fa-43cf-9029-139e993b83fd tempest-VolumesTransfersV355Test-756271995 None] Lock "b'cinder-3e653f23-5d6f-49af-8223-8dd79ec80cf4-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:37:45.283466 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1f8a12a3-d8fa-43cf-9029-139e993b83fd tempest-VolumesTransfersV355Test-756271995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:45.880144 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1f8a12a3-d8fa-43cf-9029-139e993b83fd tempest-VolumesTransfersV355Test-756271995 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:37:45.880866 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1f8a12a3-d8fa-43cf-9029-139e993b83fd tempest-VolumesTransfersV355Test-756271995 None] Volume volume-3e653f23-5d6f-49af-8223-8dd79ec80cf4 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:37:46.218422 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1f8a12a3-d8fa-43cf-9029-139e993b83fd tempest-VolumesTransfersV355Test-756271995 None] deleting rbd volume volume-3e653f23-5d6f-49af-8223-8dd79ec80cf4 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:37:49.145520 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-981f9b81-e7b0-488b-a784-4c42a4840968 tempest-VolumesTestJSON-272218658 None] Created reservations ['09f7ffbb-7d4d-4ec1-a4ad-37e231019498', '13d37642-5e3f-458a-91aa-3f93c485b370', 'a03a2de1-3107-4c0c-ba91-014e36db87ca', '863bdebc-c632-4a87-9443-575e83e08caf'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:37:49.487158 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-981f9b81-e7b0-488b-a784-4c42a4840968 tempest-VolumesTestJSON-272218658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:49.642266 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-981f9b81-e7b0-488b-a784-4c42a4840968 tempest-VolumesTestJSON-272218658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:49.670098 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-981f9b81-e7b0-488b-a784-4c42a4840968 tempest-VolumesTestJSON-272218658 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:37:49.675171 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-981f9b81-e7b0-488b-a784-4c42a4840968 tempest-VolumesTestJSON-272218658 None] Deleted volume successfully. May 02 10:37:49.697419 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a3888542-088a-40b8-9c1e-63a858c4638d tempest-VolumesTestJSON-272218658 None] Lock "b'cinder-a7ab99c0-b861-4b50-9374-5147604650c2-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:37:49.847151 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-981f9b81-e7b0-488b-a784-4c42a4840968 tempest-VolumesTestJSON-272218658 None] Lock "b'cinder-840641f6-86d9-41a1-83a4-98a4c81b447a-delete_volume'" released by "delete_volume" :: held 13.419s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:37:49.880292 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a3888542-088a-40b8-9c1e-63a858c4638d tempest-VolumesTestJSON-272218658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:50.630826 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a3888542-088a-40b8-9c1e-63a858c4638d tempest-VolumesTestJSON-272218658 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:37:50.636033 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a3888542-088a-40b8-9c1e-63a858c4638d tempest-VolumesTestJSON-272218658 None] Volume volume-a7ab99c0-b861-4b50-9374-5147604650c2 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:37:51.085782 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a3888542-088a-40b8-9c1e-63a858c4638d tempest-VolumesTestJSON-272218658 None] deleting rbd volume volume-a7ab99c0-b861-4b50-9374-5147604650c2 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:37:58.641570 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-1f8a12a3-d8fa-43cf-9029-139e993b83fd tempest-VolumesTransfersV355Test-756271995 None] Created reservations ['a0f87f2c-f80a-4871-b2f9-aab7520a3efd', '86de045c-c885-44e0-82cf-2a3a8dfdff1b', '3c18a5a2-7ba2-4615-835a-40ee8e64e564', 'b1cfdf1c-f0ed-44d4-b4b8-33964eea2cbc'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:37:58.759145 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:37:58.760189 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:58.798695 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:58.839691 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:37:58.931457 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1f8a12a3-d8fa-43cf-9029-139e993b83fd tempest-VolumesTransfersV355Test-756271995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:58.957594 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1f8a12a3-d8fa-43cf-9029-139e993b83fd tempest-VolumesTransfersV355Test-756271995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:37:58.999338 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-1f8a12a3-d8fa-43cf-9029-139e993b83fd tempest-VolumesTransfersV355Test-756271995 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:37:59.003754 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-1f8a12a3-d8fa-43cf-9029-139e993b83fd tempest-VolumesTransfersV355Test-756271995 None] Deleted volume successfully. May 02 10:37:59.192228 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-1f8a12a3-d8fa-43cf-9029-139e993b83fd tempest-VolumesTransfersV355Test-756271995 None] Lock "b'cinder-3e653f23-5d6f-49af-8223-8dd79ec80cf4-delete_volume'" released by "delete_volume" :: held 13.991s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:38:01.081230 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-a3888542-088a-40b8-9c1e-63a858c4638d tempest-VolumesTestJSON-272218658 None] Created reservations ['0a59ce33-acca-4b11-b37a-959841b9f62c', '0865e9e2-729a-4d36-a02f-49d10c18c1ad', '5362cd50-429b-4f06-9624-4c7e8ac383b0', 'e8e3c3a0-20b9-467a-892d-c707e42c1648'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:38:01.275599 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a3888542-088a-40b8-9c1e-63a858c4638d tempest-VolumesTestJSON-272218658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:01.326416 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a3888542-088a-40b8-9c1e-63a858c4638d tempest-VolumesTestJSON-272218658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:01.365273 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-a3888542-088a-40b8-9c1e-63a858c4638d tempest-VolumesTestJSON-272218658 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:38:01.369666 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a3888542-088a-40b8-9c1e-63a858c4638d tempest-VolumesTestJSON-272218658 None] Deleted volume successfully. May 02 10:38:01.450731 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a3888542-088a-40b8-9c1e-63a858c4638d tempest-VolumesTestJSON-272218658 None] Lock "b'cinder-a7ab99c0-b861-4b50-9374-5147604650c2-delete_volume'" released by "delete_volume" :: held 11.753s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:38:01.503781 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a08d792a-7ed2-4b85-90f4-94954e678702 tempest-VolumesTestJSON-272218658 None] Lock "b'cinder-79625573-a796-47b9-a8d2-5b8707c6748d-delete_volume'" acquired by "delete_volume" :: waited 0.057s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:38:01.597032 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a08d792a-7ed2-4b85-90f4-94954e678702 tempest-VolumesTestJSON-272218658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:01.895854 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a08d792a-7ed2-4b85-90f4-94954e678702 tempest-VolumesTestJSON-272218658 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:38:01.896291 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a08d792a-7ed2-4b85-90f4-94954e678702 tempest-VolumesTestJSON-272218658 None] Volume volume-79625573-a796-47b9-a8d2-5b8707c6748d is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:38:02.212762 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a08d792a-7ed2-4b85-90f4-94954e678702 tempest-VolumesTestJSON-272218658 None] deleting rbd volume volume-79625573-a796-47b9-a8d2-5b8707c6748d {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:38:05.418826 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:38:05.438525 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Flow 'volume_create_manager' (adfde7e9-d81f-4a03-857a-84f6358efc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:38:05.444898 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f351fd2-2533-421f-8d47-1a004bd846ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:05.478372 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f351fd2-2533-421f-8d47-1a004bd846ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1437514804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=63255684-7901-422a-a45e-4706b13cd8f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='29e616a0c8df45e6987aced1da716382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:38:05Z,use_quota=True,user_id='4d8ba23c64c2410da6059165b4f20bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:05.483719 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79bf1f6c-a5bd-4db8-88b2-9ed34bd21d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:05.487808 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79bf1f6c-a5bd-4db8-88b2-9ed34bd21d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:05.492889 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2791a41b-7fcc-4985-a23f-8c3afaedf5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:05.496883 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2791a41b-7fcc-4985-a23f-8c3afaedf5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63255684-7901-422a-a45e-4706b13cd8f4', 'volume_name': 'volume-63255684-7901-422a-a45e-4706b13cd8f4', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:05.502048 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7ebff0-5a8c-4010-8f3a-ae44b8504744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:05.505927 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7ebff0-5a8c-4010-8f3a-ae44b8504744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:05.510756 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e311ec-0410-40eb-ba15-37dd00236598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:05.511870 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Volume 63255684-7901-422a-a45e-4706b13cd8f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63255684-7901-422a-a45e-4706b13cd8f4', 'volume_size': 1} May 02 10:38:05.512820 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] creating volume 'volume-63255684-7901-422a-a45e-4706b13cd8f4' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:38:05.514052 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:07.022321 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:38:07.022958 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:38:07.026768 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e311ec-0410-40eb-ba15-37dd00236598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63255684-7901-422a-a45e-4706b13cd8f4', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:07.032344 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d12230-d1fd-4203-afe1-e5838e14faf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:07.126507 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Volume volume-63255684-7901-422a-a45e-4706b13cd8f4 (63255684-7901-422a-a45e-4706b13cd8f4): created successfully May 02 10:38:07.134737 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d12230-d1fd-4203-afe1-e5838e14faf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:07.157581 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Flow 'volume_create_manager' (adfde7e9-d81f-4a03-857a-84f6358efc57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:38:07.228554 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-21e3dd71-5b74-4fb1-b17b-4e4f634e1a5d tempest-VolumesListTestJSON-1974545420 None] Created volume successfully. May 02 10:38:08.219071 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:38:08.241004 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Flow 'volume_create_manager' (e83aabb3-0ac1-4824-83b1-5cc4aa19de27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:38:08.247871 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5963f81a-3949-4762-be52-63dc7869d011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:08.268177 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5963f81a-3949-4762-be52-63dc7869d011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-564452655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3759fd71-9285-4f2e-bfa8-332ea25fc2c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='29e616a0c8df45e6987aced1da716382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:38:08Z,use_quota=True,user_id='4d8ba23c64c2410da6059165b4f20bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:08.274847 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b749dd3-7c4d-4266-aa03-7b8503474adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:08.281533 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b749dd3-7c4d-4266-aa03-7b8503474adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:08.286838 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acf681d-4124-4068-beff-2c922e7cecc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:08.291073 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acf681d-4124-4068-beff-2c922e7cecc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3759fd71-9285-4f2e-bfa8-332ea25fc2c5', 'volume_name': 'volume-3759fd71-9285-4f2e-bfa8-332ea25fc2c5', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:08.296170 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5773f862-50fc-44c8-bfff-26db9ce73c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:08.300214 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5773f862-50fc-44c8-bfff-26db9ce73c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:08.305019 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0877e602-9e85-468a-a141-23da38a7c0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:08.306162 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Volume 3759fd71-9285-4f2e-bfa8-332ea25fc2c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3759fd71-9285-4f2e-bfa8-332ea25fc2c5', 'volume_size': 1} May 02 10:38:08.306556 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] creating volume 'volume-3759fd71-9285-4f2e-bfa8-332ea25fc2c5' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:38:08.307236 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:09.494672 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:38:09.495316 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:38:09.499042 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0877e602-9e85-468a-a141-23da38a7c0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3759fd71-9285-4f2e-bfa8-332ea25fc2c5', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:09.504136 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76513167-3bca-42b9-9cca-f3b01ce0563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:09.547920 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Volume volume-3759fd71-9285-4f2e-bfa8-332ea25fc2c5 (3759fd71-9285-4f2e-bfa8-332ea25fc2c5): created successfully May 02 10:38:09.551757 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76513167-3bca-42b9-9cca-f3b01ce0563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:09.557341 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Flow 'volume_create_manager' (e83aabb3-0ac1-4824-83b1-5cc4aa19de27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:38:09.623219 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-cd2c871b-1ca5-444f-9a72-3e7487a615d0 tempest-VolumesListTestJSON-1974545420 None] Created volume successfully. May 02 10:38:10.940727 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:38:10.962208 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Flow 'volume_create_manager' (41422645-2821-4fbb-8417-3141bb64ebf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:38:10.969651 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9e34ce-0310-40a8-bb84-04c01fbb5ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:10.986746 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9e34ce-0310-40a8-bb84-04c01fbb5ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1424950896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5be01227-6bf3-4a46-ade8-9b8d41a5b167,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='29e616a0c8df45e6987aced1da716382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:38:11Z,use_quota=True,user_id='4d8ba23c64c2410da6059165b4f20bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:10.992852 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43dcb249-678c-4e52-aae1-4b3b92bb1221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:10.998007 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43dcb249-678c-4e52-aae1-4b3b92bb1221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:11.005110 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efeb6da-8e7a-4963-8cd5-8bd8c1ebc847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:11.009958 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efeb6da-8e7a-4963-8cd5-8bd8c1ebc847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be01227-6bf3-4a46-ade8-9b8d41a5b167', 'volume_name': 'volume-5be01227-6bf3-4a46-ade8-9b8d41a5b167', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:11.019088 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d26dcb-09f0-4743-ab55-c871d9148aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:11.022062 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d26dcb-09f0-4743-ab55-c871d9148aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:11.027072 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10477052-8429-46d4-a882-f08c92fe99a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:11.028642 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Volume 5be01227-6bf3-4a46-ade8-9b8d41a5b167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be01227-6bf3-4a46-ade8-9b8d41a5b167', 'volume_size': 1} May 02 10:38:11.029203 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] creating volume 'volume-5be01227-6bf3-4a46-ade8-9b8d41a5b167' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:38:11.035629 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:11.318967 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-a08d792a-7ed2-4b85-90f4-94954e678702 tempest-VolumesTestJSON-272218658 None] Created reservations ['e540ce4e-8719-4e53-a27e-2d3f4d59cfe1', '357a6ce0-a605-40e9-bd8d-92b811db692b', 'b19c9a3e-afd5-4d67-bb9e-24e04e18e068', 'be2605f5-413b-4396-a211-0d3ac8aad688'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:38:11.467740 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a08d792a-7ed2-4b85-90f4-94954e678702 tempest-VolumesTestJSON-272218658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:11.491904 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a08d792a-7ed2-4b85-90f4-94954e678702 tempest-VolumesTestJSON-272218658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:11.520363 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-a08d792a-7ed2-4b85-90f4-94954e678702 tempest-VolumesTestJSON-272218658 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:38:11.525061 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a08d792a-7ed2-4b85-90f4-94954e678702 tempest-VolumesTestJSON-272218658 None] Deleted volume successfully. May 02 10:38:11.632858 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a08d792a-7ed2-4b85-90f4-94954e678702 tempest-VolumesTestJSON-272218658 None] Lock "b'cinder-79625573-a796-47b9-a8d2-5b8707c6748d-delete_volume'" released by "delete_volume" :: held 10.129s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:38:11.937184 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:38:11.938815 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:38:11.946159 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10477052-8429-46d4-a882-f08c92fe99a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be01227-6bf3-4a46-ade8-9b8d41a5b167', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:11.954968 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e76c0af-1f80-4a58-bf6b-a10b1b0d12fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:12.053224 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Volume volume-5be01227-6bf3-4a46-ade8-9b8d41a5b167 (5be01227-6bf3-4a46-ade8-9b8d41a5b167): created successfully May 02 10:38:12.066055 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e76c0af-1f80-4a58-bf6b-a10b1b0d12fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:12.088003 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Flow 'volume_create_manager' (41422645-2821-4fbb-8417-3141bb64ebf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:38:12.182836 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-625ecb03-74f4-4bf0-b50a-24f153ca8fbc tempest-VolumesListTestJSON-1974545420 None] Created volume successfully. May 02 10:38:14.218571 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Terminate volume connection completed successfully. May 02 10:38:14.245611 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-fb820719-832c-458c-bea5-bae1e9d92fed tempest-VolumesBackupsTest-1849290619 None] Remove volume export completed successfully. May 02 10:38:15.007970 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-44d86a42-94d8-458e-a8be-2652afd00285 tempest-VolumesBackupsTest-1849290619 None] Lock "b'cinder-ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:38:15.190899 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44d86a42-94d8-458e-a8be-2652afd00285 tempest-VolumesBackupsTest-1849290619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:17.983837 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44d86a42-94d8-458e-a8be-2652afd00285 tempest-VolumesBackupsTest-1849290619 None] Volume volume-ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:38:18.829021 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44d86a42-94d8-458e-a8be-2652afd00285 tempest-VolumesBackupsTest-1849290619 None] deleting rbd volume volume-ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:38:18.875601 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a4512257-f203-44de-bd7e-ce8557ac3b4e tempest-VolumesListTestJSON-1974545420 None] Lock "b'cinder-5be01227-6bf3-4a46-ade8-9b8d41a5b167-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:38:19.028621 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a4512257-f203-44de-bd7e-ce8557ac3b4e tempest-VolumesListTestJSON-1974545420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:19.479625 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a4512257-f203-44de-bd7e-ce8557ac3b4e tempest-VolumesListTestJSON-1974545420 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:38:19.480056 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a4512257-f203-44de-bd7e-ce8557ac3b4e tempest-VolumesListTestJSON-1974545420 None] Volume volume-5be01227-6bf3-4a46-ade8-9b8d41a5b167 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:38:19.727978 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a4512257-f203-44de-bd7e-ce8557ac3b4e tempest-VolumesListTestJSON-1974545420 None] deleting rbd volume volume-5be01227-6bf3-4a46-ade8-9b8d41a5b167 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:38:27.950161 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-a4512257-f203-44de-bd7e-ce8557ac3b4e tempest-VolumesListTestJSON-1974545420 None] Created reservations ['8f032bcb-c9f0-45c6-a6b5-bb0d89af5e0a', '25347215-a0e3-4e0b-b221-7c3b7ccb9251', 'b1645414-27ef-4247-90a3-a35d0c55548f', '67a96012-7e24-4764-9326-5c4e047c970c'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:38:28.183958 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a4512257-f203-44de-bd7e-ce8557ac3b4e tempest-VolumesListTestJSON-1974545420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:28.235757 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a4512257-f203-44de-bd7e-ce8557ac3b4e tempest-VolumesListTestJSON-1974545420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:28.273358 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-a4512257-f203-44de-bd7e-ce8557ac3b4e tempest-VolumesListTestJSON-1974545420 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:38:28.281921 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a4512257-f203-44de-bd7e-ce8557ac3b4e tempest-VolumesListTestJSON-1974545420 None] Deleted volume successfully. May 02 10:38:28.392950 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a4512257-f203-44de-bd7e-ce8557ac3b4e tempest-VolumesListTestJSON-1974545420 None] Lock "b'cinder-5be01227-6bf3-4a46-ade8-9b8d41a5b167-delete_volume'" released by "delete_volume" :: held 9.517s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:38:29.154091 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-1ca90a44-e855-480a-a328-dfcf7e6bf76a tempest-VolumesListTestJSON-1974545420 None] Lock "b'cinder-3759fd71-9285-4f2e-bfa8-332ea25fc2c5-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:38:29.304739 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ca90a44-e855-480a-a328-dfcf7e6bf76a tempest-VolumesListTestJSON-1974545420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:29.747042 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ca90a44-e855-480a-a328-dfcf7e6bf76a tempest-VolumesListTestJSON-1974545420 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:38:29.747643 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ca90a44-e855-480a-a328-dfcf7e6bf76a tempest-VolumesListTestJSON-1974545420 None] Volume volume-3759fd71-9285-4f2e-bfa8-332ea25fc2c5 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:38:29.995007 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ca90a44-e855-480a-a328-dfcf7e6bf76a tempest-VolumesListTestJSON-1974545420 None] deleting rbd volume volume-3759fd71-9285-4f2e-bfa8-332ea25fc2c5 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:38:32.428394 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-44d86a42-94d8-458e-a8be-2652afd00285 tempest-VolumesBackupsTest-1849290619 None] Created reservations ['9aa00d70-e12a-4a11-911e-2aca0c7680c3', 'd1d36d9a-d894-42fe-b3b4-6565f7cbfbd2', 'b2afb81e-1402-4ae4-9928-423c61286b11', '96b58cae-461d-4451-be6a-0b9ba595b768'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:38:32.687377 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44d86a42-94d8-458e-a8be-2652afd00285 tempest-VolumesBackupsTest-1849290619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:32.749278 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44d86a42-94d8-458e-a8be-2652afd00285 tempest-VolumesBackupsTest-1849290619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:32.820685 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44d86a42-94d8-458e-a8be-2652afd00285 tempest-VolumesBackupsTest-1849290619 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:38:32.832922 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-44d86a42-94d8-458e-a8be-2652afd00285 tempest-VolumesBackupsTest-1849290619 None] Deleted volume successfully. May 02 10:38:32.906760 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-44d86a42-94d8-458e-a8be-2652afd00285 tempest-VolumesBackupsTest-1849290619 None] Lock "b'cinder-ed1e3fc5-f3c6-40bd-8c28-d19c62ac883a-delete_volume'" released by "delete_volume" :: held 17.899s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:38:38.393726 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-1ca90a44-e855-480a-a328-dfcf7e6bf76a tempest-VolumesListTestJSON-1974545420 None] Created reservations ['58d2db00-aab4-4f4b-b965-8a1c8049745f', '9cc8f198-8a13-4aad-b9db-02c8acfabf6c', '10560325-fe72-4e93-a72b-18ad74add841', '852485b2-498f-463c-96bc-cb28cb86d94c'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:38:38.576928 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ca90a44-e855-480a-a328-dfcf7e6bf76a tempest-VolumesListTestJSON-1974545420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:38.634669 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ca90a44-e855-480a-a328-dfcf7e6bf76a tempest-VolumesListTestJSON-1974545420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:38.727257 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-1ca90a44-e855-480a-a328-dfcf7e6bf76a tempest-VolumesListTestJSON-1974545420 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:38:38.731995 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-1ca90a44-e855-480a-a328-dfcf7e6bf76a tempest-VolumesListTestJSON-1974545420 None] Deleted volume successfully. May 02 10:38:38.806273 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-1ca90a44-e855-480a-a328-dfcf7e6bf76a tempest-VolumesListTestJSON-1974545420 None] Lock "b'cinder-3759fd71-9285-4f2e-bfa8-332ea25fc2c5-delete_volume'" released by "delete_volume" :: held 9.644s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:38:38.961466 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-d2825bd8-d2c5-4b08-9b91-68987b3ad797 tempest-VolumesListTestJSON-1974545420 None] Lock "b'cinder-63255684-7901-422a-a45e-4706b13cd8f4-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:38:39.153705 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d2825bd8-d2c5-4b08-9b91-68987b3ad797 tempest-VolumesListTestJSON-1974545420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:39.365113 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d2825bd8-d2c5-4b08-9b91-68987b3ad797 tempest-VolumesListTestJSON-1974545420 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:38:39.365254 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d2825bd8-d2c5-4b08-9b91-68987b3ad797 tempest-VolumesListTestJSON-1974545420 None] Volume volume-63255684-7901-422a-a45e-4706b13cd8f4 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:38:39.671483 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d2825bd8-d2c5-4b08-9b91-68987b3ad797 tempest-VolumesListTestJSON-1974545420 None] deleting rbd volume volume-63255684-7901-422a-a45e-4706b13cd8f4 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:38:43.427216 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-5dc07dc8-76b4-4729-b13b-f37b8f1e0481 req-001432e0-de1c-4e75-bec1-e8b09373a1e8 tempest-ServerRescueNegativeTestJSON-55061976 None] Terminate volume connection completed successfully. May 02 10:38:43.428019 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-5dc07dc8-76b4-4729-b13b-f37b8f1e0481 req-001432e0-de1c-4e75-bec1-e8b09373a1e8 tempest-ServerRescueNegativeTestJSON-55061976 None] Deleting attachment d6014f46-7a0d-41ee-b6dd-c52ad478e8bd. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:38:48.330280 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-d2825bd8-d2c5-4b08-9b91-68987b3ad797 tempest-VolumesListTestJSON-1974545420 None] Created reservations ['7538865e-40ad-4bc6-9081-7e95d849477f', '996f78bd-e642-4e93-91f7-a8f05c46d61e', '936b9e40-a1b3-48d9-96c7-c71fce9924b1', '52ee0c76-2287-44d6-98a8-f8086825bacb'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:38:48.524233 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d2825bd8-d2c5-4b08-9b91-68987b3ad797 tempest-VolumesListTestJSON-1974545420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:48.610547 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d2825bd8-d2c5-4b08-9b91-68987b3ad797 tempest-VolumesListTestJSON-1974545420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:48.697059 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-d2825bd8-d2c5-4b08-9b91-68987b3ad797 tempest-VolumesListTestJSON-1974545420 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:38:48.701495 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-d2825bd8-d2c5-4b08-9b91-68987b3ad797 tempest-VolumesListTestJSON-1974545420 None] Deleted volume successfully. May 02 10:38:48.766582 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-d2825bd8-d2c5-4b08-9b91-68987b3ad797 tempest-VolumesListTestJSON-1974545420 None] Lock "b'cinder-63255684-7901-422a-a45e-4706b13cd8f4-delete_volume'" released by "delete_volume" :: held 9.805s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:38:52.096476 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-2b7ad2ae-162c-49ff-bf3d-34e2e9938ad9 tempest-VolumesBackupsTest-1849290619 None] Lock "b'cinder-6a607ad4-7820-465b-a861-f796c57fde8c-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:38:52.244373 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b7ad2ae-162c-49ff-bf3d-34e2e9938ad9 tempest-VolumesBackupsTest-1849290619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:56.468986 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b7ad2ae-162c-49ff-bf3d-34e2e9938ad9 tempest-VolumesBackupsTest-1849290619 None] deleting rbd volume volume-6a607ad4-7820-465b-a861-f796c57fde8c {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:38:56.511088 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-9d4c7c99-cfcd-4891-ba5d-d24e6b2b8987 tempest-ServerRescueNegativeTestJSON-55061976 None] Lock "b'cinder-797c071d-7bc2-466c-b6e2-a2f1160b8be5-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:38:56.585744 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:38:56.609288 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Flow 'volume_create_manager' (66dad12b-8311-46f7-8e65-ead3b26ec622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:38:56.617064 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e708b77-8588-4349-b0a8-34f6fbc6822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:56.633400 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e708b77-8588-4349-b0a8-34f6fbc6822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2138843853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=075071a8-e38b-474a-b12b-0495de3196dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d72c31f7ad4e3e96bdb585f2890f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:38:53Z,use_quota=True,user_id='5c80bb9dda7f460dac27aff66ef40947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:56.640180 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a7c9c0-c6bf-4a78-9a56-4b8bf2b32fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:56.644574 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a7c9c0-c6bf-4a78-9a56-4b8bf2b32fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:56.650089 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d51a40-b660-49ce-85b5-4e0e018f54b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:56.654864 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d51a40-b660-49ce-85b5-4e0e018f54b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075071a8-e38b-474a-b12b-0495de3196dd', 'volume_name': 'volume-075071a8-e38b-474a-b12b-0495de3196dd', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:56.660022 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aedb4f6-465f-473d-955e-2fd26b0f2d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:56.664051 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aedb4f6-465f-473d-955e-2fd26b0f2d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:56.669032 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29ccb4d-dead-4b28-aaa8-2c6a552dd24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:56.670189 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Volume 075071a8-e38b-474a-b12b-0495de3196dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075071a8-e38b-474a-b12b-0495de3196dd', 'volume_size': 1} May 02 10:38:56.670587 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] creating volume 'volume-075071a8-e38b-474a-b12b-0495de3196dd' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:38:56.671410 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:56.722482 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9d4c7c99-cfcd-4891-ba5d-d24e6b2b8987 tempest-ServerRescueNegativeTestJSON-55061976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:56.975044 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9d4c7c99-cfcd-4891-ba5d-d24e6b2b8987 tempest-ServerRescueNegativeTestJSON-55061976 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:38:56.975044 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9d4c7c99-cfcd-4891-ba5d-d24e6b2b8987 tempest-ServerRescueNegativeTestJSON-55061976 None] Volume volume-797c071d-7bc2-466c-b6e2-a2f1160b8be5 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:38:57.390766 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9d4c7c99-cfcd-4891-ba5d-d24e6b2b8987 tempest-ServerRescueNegativeTestJSON-55061976 None] deleting rbd volume volume-797c071d-7bc2-466c-b6e2-a2f1160b8be5 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:38:57.950262 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:38:57.951019 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:38:57.954598 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29ccb4d-dead-4b28-aaa8-2c6a552dd24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075071a8-e38b-474a-b12b-0495de3196dd', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:57.959232 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0057b55-4d99-400e-94b9-1620895e1a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:38:58.112956 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Volume volume-075071a8-e38b-474a-b12b-0495de3196dd (075071a8-e38b-474a-b12b-0495de3196dd): created successfully May 02 10:38:58.116724 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0057b55-4d99-400e-94b9-1620895e1a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:38:58.123217 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Flow 'volume_create_manager' (66dad12b-8311-46f7-8e65-ead3b26ec622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:38:58.237206 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b66ab6a2-128c-48e6-8efc-eb8bd8418ea4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Created volume successfully. May 02 10:38:58.757644 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:38:58.758249 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:58.784494 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:38:58.911330 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:38:58.931258 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bc16dbe0-24cf-412b-88a1-5f4030068269 tempest-VolumesSnapshotListTestJSON-1199918488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:02.719053 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-bc16dbe0-24cf-412b-88a1-5f4030068269 tempest-VolumesSnapshotListTestJSON-1199918488 None] Create snapshot completed successfully May 02 10:39:03.482916 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e47d6b94-2154-49ec-9688-4b71316ca5c1 tempest-VolumesSnapshotListTestJSON-1199918488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:06.383478 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b7ad2ae-162c-49ff-bf3d-34e2e9938ad9 tempest-VolumesBackupsTest-1849290619 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:39:06.652194 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b7ad2ae-162c-49ff-bf3d-34e2e9938ad9 tempest-VolumesBackupsTest-1849290619 None] deleting parent snapshot volume-6a607ad4-7820-465b-a861-f796c57fde8c.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:39:10.992540 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-9a253288-bf39-428b-84d2-058088872d92 tempest-GroupsV314Test-95298059 None] Group tempest-GroupsV314Test-Group-604846268: creating May 02 10:39:11.177044 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-9a253288-bf39-428b-84d2-058088872d92 tempest-GroupsV314Test-95298059 None] Group tempest-GroupsV314Test-Group-604846268: created successfully May 02 10:39:11.187767 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-9a253288-bf39-428b-84d2-058088872d92 tempest-GroupsV314Test-95298059 None] Create group completed successfully. May 02 10:39:11.198983 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-2b7ad2ae-162c-49ff-bf3d-34e2e9938ad9 tempest-VolumesBackupsTest-1849290619 None] Created reservations ['72cf1201-3000-4f72-988d-bcdd15267448', '7bffa4fe-e7a0-4f92-8b96-abc0b41be744', '6665fa8e-7dbf-45e9-bbd8-299fcb842696', 'f33bfa24-b670-4a8f-a8af-e1f0612ddabc'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:39:11.238387 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-9d4c7c99-cfcd-4891-ba5d-d24e6b2b8987 tempest-ServerRescueNegativeTestJSON-55061976 None] Created reservations ['6454e0e6-df56-4d51-a1fe-e54fb7de13b1', '6da9664a-75c1-4fab-8fec-26bd24cb0502', '3c6c18b6-4ff3-47b1-8b2a-6f0be3633664', 'fc6e15a6-1be4-47fc-a44d-aee741185f69'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:39:11.440506 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9d4c7c99-cfcd-4891-ba5d-d24e6b2b8987 tempest-ServerRescueNegativeTestJSON-55061976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:11.476068 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9d4c7c99-cfcd-4891-ba5d-d24e6b2b8987 tempest-ServerRescueNegativeTestJSON-55061976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:11.541626 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-9d4c7c99-cfcd-4891-ba5d-d24e6b2b8987 tempest-ServerRescueNegativeTestJSON-55061976 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:39:11.547810 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-9d4c7c99-cfcd-4891-ba5d-d24e6b2b8987 tempest-ServerRescueNegativeTestJSON-55061976 None] Deleted volume successfully. May 02 10:39:11.678258 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7c91b4dd-ac0a-4d05-b162-ebe8b4270e6b tempest-ServerRescueNegativeTestJSON-55061976 None] Lock "b'cinder-3ec5212e-a606-4f41-ab18-57576ff1e817-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:39:11.698211 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b7ad2ae-162c-49ff-bf3d-34e2e9938ad9 tempest-VolumesBackupsTest-1849290619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:11.734564 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b7ad2ae-162c-49ff-bf3d-34e2e9938ad9 tempest-VolumesBackupsTest-1849290619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:11.774611 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-2b7ad2ae-162c-49ff-bf3d-34e2e9938ad9 tempest-VolumesBackupsTest-1849290619 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:39:11.785098 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-9d4c7c99-cfcd-4891-ba5d-d24e6b2b8987 tempest-ServerRescueNegativeTestJSON-55061976 None] Lock "b'cinder-797c071d-7bc2-466c-b6e2-a2f1160b8be5-delete_volume'" released by "delete_volume" :: held 15.274s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:39:11.804006 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2b7ad2ae-162c-49ff-bf3d-34e2e9938ad9 tempest-VolumesBackupsTest-1849290619 None] Deleted volume successfully. May 02 10:39:11.816905 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7c91b4dd-ac0a-4d05-b162-ebe8b4270e6b tempest-ServerRescueNegativeTestJSON-55061976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:12.233163 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7c91b4dd-ac0a-4d05-b162-ebe8b4270e6b tempest-ServerRescueNegativeTestJSON-55061976 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:39:12.234687 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7c91b4dd-ac0a-4d05-b162-ebe8b4270e6b tempest-ServerRescueNegativeTestJSON-55061976 None] Volume volume-3ec5212e-a606-4f41-ab18-57576ff1e817 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:39:12.565024 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7c91b4dd-ac0a-4d05-b162-ebe8b4270e6b tempest-ServerRescueNegativeTestJSON-55061976 None] deleting rbd volume volume-3ec5212e-a606-4f41-ab18-57576ff1e817 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:39:12.616115 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-2b7ad2ae-162c-49ff-bf3d-34e2e9938ad9 tempest-VolumesBackupsTest-1849290619 None] Lock "b'cinder-6a607ad4-7820-465b-a861-f796c57fde8c-delete_volume'" released by "delete_volume" :: held 20.516s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:39:12.731625 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e47d6b94-2154-49ec-9688-4b71316ca5c1 tempest-VolumesSnapshotListTestJSON-1199918488 None] Create snapshot completed successfully May 02 10:39:13.194017 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:39:13.215529 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Flow 'volume_create_manager' (85fda0b9-61c6-4f93-9ee3-5d64aa85c20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:39:13.224514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9564b8-8d34-47b5-8523-39ca834b68f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:39:13.240079 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9564b8-8d34-47b5-8523-39ca834b68f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-275714441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6995fa06-542f-4fb3-bd5d-87a03cdc0d66,host='ncdv-master-1@ceph#ceph',id=ab6910a9-0d55-414a-8962-2bebaa835f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b966b8424fbd467a9bbf41c754440659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:39:13Z,use_quota=True,user_id='dee15583ccd24533ad03df793aa9e8dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6831219-d191-4541-93c1-bdeaa44c36da),volume_type_id=e6831219-d191-4541-93c1-bdeaa44c36da)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:39:13.246433 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55768619-38ee-4cac-b9d9-15ae7dd70f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:39:13.251333 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55768619-38ee-4cac-b9d9-15ae7dd70f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:39:13.256741 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50befcd5-6144-4424-833a-ee0329114fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:39:13.261916 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50befcd5-6144-4424-833a-ee0329114fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6910a9-0d55-414a-8962-2bebaa835f21', 'volume_name': 'volume-ab6910a9-0d55-414a-8962-2bebaa835f21', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:39:13.267076 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9f59ca-f52a-4ce2-b5d9-6181843441a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:39:13.271354 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9f59ca-f52a-4ce2-b5d9-6181843441a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:39:13.276453 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c38856c-3f21-4f8b-8282-0785bada98fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:39:13.277643 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Volume ab6910a9-0d55-414a-8962-2bebaa835f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6910a9-0d55-414a-8962-2bebaa835f21', 'volume_size': 1} May 02 10:39:13.278045 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] creating volume 'volume-ab6910a9-0d55-414a-8962-2bebaa835f21' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:39:13.278841 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:14.380441 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:39:14.381376 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:39:14.385668 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c38856c-3f21-4f8b-8282-0785bada98fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6910a9-0d55-414a-8962-2bebaa835f21', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:39:14.391908 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a1bd61-b8ac-4e38-8fbf-b43cbb635a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:39:14.520745 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Volume volume-ab6910a9-0d55-414a-8962-2bebaa835f21 (ab6910a9-0d55-414a-8962-2bebaa835f21): created successfully May 02 10:39:14.524037 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a1bd61-b8ac-4e38-8fbf-b43cbb635a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:39:14.530475 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Flow 'volume_create_manager' (85fda0b9-61c6-4f93-9ee3-5d64aa85c20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:39:14.545233 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5a30c601-edc1-4b99-ae28-fe574dbed888 tempest-VolumesSnapshotListTestJSON-1199918488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:14.835306 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4f81b257-46ae-455e-9f32-b678231bc8a1 tempest-GroupsV314Test-95298059 None] Created volume successfully. May 02 10:39:16.461703 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:39:16.486651 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Flow 'volume_create_manager' (5710b8f8-08e4-47d0-a64b-c31fd4732cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:39:16.493323 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c759ba79-99c9-46e4-a04a-fa61605c4f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:39:16.509419 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c759ba79-99c9-46e4-a04a-fa61605c4f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-515823932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f8a426a0-2921-4da7-a459-d3ceeaacd638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb3f9dce951489aafe56b0d30841164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:39:16Z,use_quota=True,user_id='a6cd9c820ef74b2f9ef7db7846159495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:39:16.516275 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa538a6-921a-451b-960a-0be6026e7f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:39:16.520534 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa538a6-921a-451b-960a-0be6026e7f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:39:16.526517 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d026211-50ad-4832-a109-8b350a361fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:39:16.530655 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d026211-50ad-4832-a109-8b350a361fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a426a0-2921-4da7-a459-d3ceeaacd638', 'volume_name': 'volume-f8a426a0-2921-4da7-a459-d3ceeaacd638', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:39:16.535641 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5ad698-f8cd-4a6c-9a88-23a3236dfd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:39:16.539685 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5ad698-f8cd-4a6c-9a88-23a3236dfd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:39:16.544524 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3cdb48c-b4bb-4a7d-a0f7-21c37306b928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:39:16.545657 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Volume f8a426a0-2921-4da7-a459-d3ceeaacd638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a426a0-2921-4da7-a459-d3ceeaacd638', 'volume_size': 1} May 02 10:39:16.546056 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] creating volume 'volume-f8a426a0-2921-4da7-a459-d3ceeaacd638' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:39:16.546746 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:16.705741 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b03dfdd-b55d-4ae2-b7de-f64e091256de tempest-GroupsV314Test-95298059 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:17.375312 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b03dfdd-b55d-4ae2-b7de-f64e091256de tempest-GroupsV314Test-95298059 None] creating snapshot='volume-49918bd8-8bfc-4fa8-bbbb-686855dc9f8c.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:39:20.794859 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b03dfdd-b55d-4ae2-b7de-f64e091256de tempest-GroupsV314Test-95298059 None] cloning 'volume-ab6910a9-0d55-414a-8962-2bebaa835f21@volume-49918bd8-8bfc-4fa8-bbbb-686855dc9f8c.clone_snap' to 'volume-49918bd8-8bfc-4fa8-bbbb-686855dc9f8c' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:39:20.803572 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:39:20.804286 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:39:20.809156 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3cdb48c-b4bb-4a7d-a0f7-21c37306b928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a426a0-2921-4da7-a459-d3ceeaacd638', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:39:20.816640 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3355d317-0ca2-403f-bdfb-cfaf5975bfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:39:20.921464 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Volume volume-f8a426a0-2921-4da7-a459-d3ceeaacd638 (f8a426a0-2921-4da7-a459-d3ceeaacd638): created successfully May 02 10:39:20.925389 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3355d317-0ca2-403f-bdfb-cfaf5975bfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:39:20.931846 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Flow 'volume_create_manager' (5710b8f8-08e4-47d0-a64b-c31fd4732cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:39:21.117219 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e1b0ecb6-32ef-4c60-93fb-a95c5529b868 tempest-VolumesBackupsV39Test-169541720 None] Created volume successfully. May 02 10:39:21.976353 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-7c91b4dd-ac0a-4d05-b162-ebe8b4270e6b tempest-ServerRescueNegativeTestJSON-55061976 None] Created reservations ['049d4b14-7421-4093-9f6a-9856f4c87c22', '4878c39d-ef60-4804-a41e-e93f66cb8ee7', 'fad42d71-e54e-4212-8828-c80326465a9e', 'e4104fc4-70ef-47a9-8de6-e5ace221279d'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:39:22.198939 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-33143db9-c27b-47f8-acd5-26cf026540be tempest-VolumesBackupsV39Test-169541720 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-02T10:39:21Z,data_timestamp=2022-05-02T10:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1114473205',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=0c8a6cc7-d457-4a3d-8d37-477336ffc040,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6fb3f9dce951489aafe56b0d30841164',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a6cd9c820ef74b2f9ef7db7846159495',volume_id=f8a426a0-2921-4da7-a459-d3ceeaacd638) May 02 10:39:22.200049 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.backup.rpcapi [None req-33143db9-c27b-47f8-acd5-26cf026540be tempest-VolumesBackupsV39Test-169541720 None] continue_backup in rpcapi backup_id 0c8a6cc7-d457-4a3d-8d37-477336ffc040 {{(pid=123784) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 02 10:39:22.266461 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5a30c601-edc1-4b99-ae28-fe574dbed888 tempest-VolumesSnapshotListTestJSON-1199918488 None] Create snapshot completed successfully May 02 10:39:22.291051 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7c91b4dd-ac0a-4d05-b162-ebe8b4270e6b tempest-ServerRescueNegativeTestJSON-55061976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:22.354604 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7c91b4dd-ac0a-4d05-b162-ebe8b4270e6b tempest-ServerRescueNegativeTestJSON-55061976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:22.385249 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-7c91b4dd-ac0a-4d05-b162-ebe8b4270e6b tempest-ServerRescueNegativeTestJSON-55061976 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:39:22.390155 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-7c91b4dd-ac0a-4d05-b162-ebe8b4270e6b tempest-ServerRescueNegativeTestJSON-55061976 None] Deleted volume successfully. May 02 10:39:22.397755 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-33143db9-c27b-47f8-acd5-26cf026540be tempest-VolumesBackupsV39Test-169541720 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:39:22.515101 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7c91b4dd-ac0a-4d05-b162-ebe8b4270e6b tempest-ServerRescueNegativeTestJSON-55061976 None] Lock "b'cinder-3ec5212e-a606-4f41-ab18-57576ff1e817-delete_volume'" released by "delete_volume" :: held 10.837s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:39:23.203702 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-33143db9-c27b-47f8-acd5-26cf026540be tempest-VolumesBackupsV39Test-169541720 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.803s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:39:23.205403 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-33143db9-c27b-47f8-acd5-26cf026540be tempest-VolumesBackupsV39Test-169541720 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f8a426a0-2921-4da7-a459-d3ceeaacd638', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'f8a426a0-2921-4da7-a459-d3ceeaacd638', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:39:23.259526 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b03dfdd-b55d-4ae2-b7de-f64e091256de tempest-GroupsV314Test-95298059 None] Volume volume-ab6910a9-0d55-414a-8962-2bebaa835f21 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:39:23.272435 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-33143db9-c27b-47f8-acd5-26cf026540be tempest-VolumesBackupsV39Test-169541720 None] Initialize volume connection completed successfully. May 02 10:39:23.294951 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b03dfdd-b55d-4ae2-b7de-f64e091256de tempest-GroupsV314Test-95298059 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:39:23.298344 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b03dfdd-b55d-4ae2-b7de-f64e091256de tempest-GroupsV314Test-95298059 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:39:24.058997 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b03dfdd-b55d-4ae2-b7de-f64e091256de tempest-GroupsV314Test-95298059 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:39:24.127214 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-14e08ec7-bb2c-4df2-9f2d-0e49c864e00a tempest-VolumesSnapshotListTestJSON-1199918488 None] Lock "b'cinder-7ac4caf6-7c1d-4148-8444-a3286d23ce10-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:39:24.127214 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-14e08ec7-bb2c-4df2-9f2d-0e49c864e00a tempest-VolumesSnapshotListTestJSON-1199918488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:24.807908 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2b03dfdd-b55d-4ae2-b7de-f64e091256de tempest-GroupsV314Test-95298059 None] Create group from source-group-6995fa06-542f-4fb3-bd5d-87a03cdc0d66 completed successfully. May 02 10:39:26.133002 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:26.449871 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:39:26.713871 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] deleting rbd volume volume-49918bd8-8bfc-4fa8-bbbb-686855dc9f8c {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:39:28.832358 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-14e08ec7-bb2c-4df2-9f2d-0e49c864e00a tempest-VolumesSnapshotListTestJSON-1199918488 None] Created reservations ['1c4fdd50-c359-438d-bf66-6a374551c609', 'b528868f-36ec-4d5d-acd0-3e06f3553b8d', '3adfc8f3-65db-49b2-8c83-485fcc72865d', '49ef709e-9ced-4d3d-8f8f-9d486edeba50'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:39:29.021077 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-14e08ec7-bb2c-4df2-9f2d-0e49c864e00a tempest-VolumesSnapshotListTestJSON-1199918488 None] Delete snapshot completed successfully. May 02 10:39:29.026425 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-14e08ec7-bb2c-4df2-9f2d-0e49c864e00a tempest-VolumesSnapshotListTestJSON-1199918488 None] Lock "b'cinder-7ac4caf6-7c1d-4148-8444-a3286d23ce10-delete_snapshot'" released by "delete_snapshot" :: held 4.903s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:39:29.450661 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-3b9e9c14-fe21-4a9d-b144-4e51f77a1ee4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Lock "b'cinder-897e04c2-68c2-41eb-8af9-0aeb3f1e8716-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:39:29.452579 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3b9e9c14-fe21-4a9d-b144-4e51f77a1ee4 tempest-VolumesSnapshotListTestJSON-1199918488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:32.005648 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-33143db9-c27b-47f8-acd5-26cf026540be tempest-VolumesBackupsV39Test-169541720 None] Terminate volume connection completed successfully. May 02 10:39:32.025631 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-33143db9-c27b-47f8-acd5-26cf026540be tempest-VolumesBackupsV39Test-169541720 None] Remove volume export completed successfully. May 02 10:39:34.249229 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-3b9e9c14-fe21-4a9d-b144-4e51f77a1ee4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Created reservations ['fb25e5b5-4a74-4875-9b47-79ee61519c9d', 'ba819b4d-6009-43bf-a9c9-43fefb69326a', '74799517-350a-4258-8d9b-6c8b752b8036', '91ac82c0-56b6-4112-a5cf-d4cb301fedc8'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:39:34.503450 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3b9e9c14-fe21-4a9d-b144-4e51f77a1ee4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Delete snapshot completed successfully. May 02 10:39:34.509814 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-3b9e9c14-fe21-4a9d-b144-4e51f77a1ee4 tempest-VolumesSnapshotListTestJSON-1199918488 None] Lock "b'cinder-897e04c2-68c2-41eb-8af9-0aeb3f1e8716-delete_snapshot'" released by "delete_snapshot" :: held 5.058s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:39:34.828442 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f3818a02-b5d5-46cd-b704-d1b566bba0ea tempest-VolumesSnapshotListTestJSON-1199918488 None] Lock "b'cinder-a1094be2-06fd-4da9-a464-62f92b8a1852-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:39:34.830489 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f3818a02-b5d5-46cd-b704-d1b566bba0ea tempest-VolumesSnapshotListTestJSON-1199918488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:35.244092 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:39:35.423532 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] Volume volume-ab6910a9-0d55-414a-8962-2bebaa835f21 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:39:35.425469 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] deleting parent snapshot volume-49918bd8-8bfc-4fa8-bbbb-686855dc9f8c.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:39:40.277813 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] Created reservations ['b7360f7e-56da-4a2d-b9bc-6f69bdc1d904'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:39:40.297278 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1302004568 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1302004568, it is now deprecated. Please use the default quota class for default quota. May 02 10:39:40.298148 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1302004568 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1302004568, it is now deprecated. Please use the default quota class for default quota. May 02 10:39:40.384698 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] Created reservations ['57ba4fe7-dafe-439d-95ea-495bf9217dcc', '5110ac67-721d-4858-ba29-07d06b70ba93', '38419b7b-6825-4475-8f99-70ae3c6d1026', '6890bcf5-b01c-4355-bc2a-98cffe02cecf'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:39:40.858469 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:40.887972 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:40.914591 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:39:40.923103 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-ee0502b3-2bcc-4df0-a0f8-0ecc3edf8662 tempest-GroupsV314Test-95298059 None] Delete group completed successfully. May 02 10:39:41.826643 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f5512594-ea81-40f8-a481-67b497555031 tempest-GroupsV314Test-95298059 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:42.341638 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f5512594-ea81-40f8-a481-67b497555031 tempest-GroupsV314Test-95298059 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:39:42.343709 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f5512594-ea81-40f8-a481-67b497555031 tempest-GroupsV314Test-95298059 None] Volume volume-ab6910a9-0d55-414a-8962-2bebaa835f21 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:39:42.753046 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f5512594-ea81-40f8-a481-67b497555031 tempest-GroupsV314Test-95298059 None] deleting rbd volume volume-ab6910a9-0d55-414a-8962-2bebaa835f21 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:39:44.627503 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-f3818a02-b5d5-46cd-b704-d1b566bba0ea tempest-VolumesSnapshotListTestJSON-1199918488 None] Created reservations ['3e4f7fff-f509-4bce-b6d6-687494993347', 'a77f4ebe-5f10-4c3b-a679-ed48243ce101', '928ff982-006a-41e4-b024-393b90124acc', '57163b02-a80c-4c3e-bdbc-bced08644f0b'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:39:44.884963 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f3818a02-b5d5-46cd-b704-d1b566bba0ea tempest-VolumesSnapshotListTestJSON-1199918488 None] Delete snapshot completed successfully. May 02 10:39:44.892484 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f3818a02-b5d5-46cd-b704-d1b566bba0ea tempest-VolumesSnapshotListTestJSON-1199918488 None] Lock "b'cinder-a1094be2-06fd-4da9-a464-62f92b8a1852-delete_snapshot'" released by "delete_snapshot" :: held 10.065s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:39:45.645150 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-72b93324-5df4-4456-aa41-576c4ae07bea tempest-VolumesSnapshotListTestJSON-1199918488 None] Lock "b'cinder-075071a8-e38b-474a-b12b-0495de3196dd-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:39:45.824030 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-72b93324-5df4-4456-aa41-576c4ae07bea tempest-VolumesSnapshotListTestJSON-1199918488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:46.068434 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-72b93324-5df4-4456-aa41-576c4ae07bea tempest-VolumesSnapshotListTestJSON-1199918488 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:39:46.068902 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-72b93324-5df4-4456-aa41-576c4ae07bea tempest-VolumesSnapshotListTestJSON-1199918488 None] Volume volume-075071a8-e38b-474a-b12b-0495de3196dd is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:39:46.408440 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-72b93324-5df4-4456-aa41-576c4ae07bea tempest-VolumesSnapshotListTestJSON-1199918488 None] deleting rbd volume volume-075071a8-e38b-474a-b12b-0495de3196dd {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:39:48.392628 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a086e789-03cc-4af8-b1be-bac41a649737 tempest-VolumesBackupsV39Test-169541720 None] Lock "b'cinder-f8a426a0-2921-4da7-a459-d3ceeaacd638-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:39:48.559113 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a086e789-03cc-4af8-b1be-bac41a649737 tempest-VolumesBackupsV39Test-169541720 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:52.472078 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a086e789-03cc-4af8-b1be-bac41a649737 tempest-VolumesBackupsV39Test-169541720 None] Volume volume-f8a426a0-2921-4da7-a459-d3ceeaacd638 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:39:53.490908 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a086e789-03cc-4af8-b1be-bac41a649737 tempest-VolumesBackupsV39Test-169541720 None] deleting rbd volume volume-f8a426a0-2921-4da7-a459-d3ceeaacd638 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:39:54.118572 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-f5512594-ea81-40f8-a481-67b497555031 tempest-GroupsV314Test-95298059 None] Created reservations ['6aaa9961-46ea-4c00-a53f-277610ef8f81'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:39:54.283210 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-f5512594-ea81-40f8-a481-67b497555031 tempest-GroupsV314Test-95298059 None] Created reservations ['22779100-eb74-46c2-9d76-a29f38637aae', '30d8b354-fa98-472a-a2b4-379b90c9a011', '69d2de17-1659-4169-bd8b-344e73114e13', '950d1475-7e97-46e0-bd0e-f57c5715ba45'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:39:54.759462 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f5512594-ea81-40f8-a481-67b497555031 tempest-GroupsV314Test-95298059 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:54.860935 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f5512594-ea81-40f8-a481-67b497555031 tempest-GroupsV314Test-95298059 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:54.902166 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-f5512594-ea81-40f8-a481-67b497555031 tempest-GroupsV314Test-95298059 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:39:54.911012 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f5512594-ea81-40f8-a481-67b497555031 tempest-GroupsV314Test-95298059 None] Delete group completed successfully. May 02 10:39:55.432261 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-72b93324-5df4-4456-aa41-576c4ae07bea tempest-VolumesSnapshotListTestJSON-1199918488 None] Created reservations ['ac9c6120-92ba-443f-99a4-36003edb1c51', '60a02d16-c0d5-428d-8ae5-4b69afe1947d', '19203612-45d8-4caa-8dfc-7a3b1778feeb', 'e571dd4a-df02-4621-86e9-a9b0e6b19064'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:39:55.691024 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-72b93324-5df4-4456-aa41-576c4ae07bea tempest-VolumesSnapshotListTestJSON-1199918488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:55.763430 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-72b93324-5df4-4456-aa41-576c4ae07bea tempest-VolumesSnapshotListTestJSON-1199918488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:55.810430 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-72b93324-5df4-4456-aa41-576c4ae07bea tempest-VolumesSnapshotListTestJSON-1199918488 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:39:55.821034 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-72b93324-5df4-4456-aa41-576c4ae07bea tempest-VolumesSnapshotListTestJSON-1199918488 None] Deleted volume successfully. May 02 10:39:55.905775 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-72b93324-5df4-4456-aa41-576c4ae07bea tempest-VolumesSnapshotListTestJSON-1199918488 None] Lock "b'cinder-075071a8-e38b-474a-b12b-0495de3196dd-delete_volume'" released by "delete_volume" :: held 10.267s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:39:58.762317 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:39:58.763023 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:58.821405 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:39:58.863995 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:40:02.282967 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-a086e789-03cc-4af8-b1be-bac41a649737 tempest-VolumesBackupsV39Test-169541720 None] Created reservations ['b7da58be-267e-4409-88a1-ab45bfd4b7ca', '94463c32-fc2e-409d-8d0f-43b191659f2f', 'f0d581c2-4413-47eb-a063-8d852a919cc4', 'bec5df55-8837-4d38-8353-d8f9c07292dd'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:40:02.542235 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a086e789-03cc-4af8-b1be-bac41a649737 tempest-VolumesBackupsV39Test-169541720 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:02.622738 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a086e789-03cc-4af8-b1be-bac41a649737 tempest-VolumesBackupsV39Test-169541720 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:02.676938 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-a086e789-03cc-4af8-b1be-bac41a649737 tempest-VolumesBackupsV39Test-169541720 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:40:02.682060 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a086e789-03cc-4af8-b1be-bac41a649737 tempest-VolumesBackupsV39Test-169541720 None] Deleted volume successfully. May 02 10:40:02.745750 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a086e789-03cc-4af8-b1be-bac41a649737 tempest-VolumesBackupsV39Test-169541720 None] Lock "b'cinder-f8a426a0-2921-4da7-a459-d3ceeaacd638-delete_volume'" released by "delete_volume" :: held 14.353s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:40:15.461362 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:40:15.575626 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Flow 'volume_create_manager' (448a1db6-5235-48d7-b813-4dc5c1cb893c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:40:15.595791 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74bad19-cfe4-4b1e-b0aa-153e5aa73ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:40:15.644805 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74bad19-cfe4-4b1e-b0aa-153e5aa73ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1124454823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=023f6512-a5b6-488a-94da-4950eb9d53ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da89947cbda467c9eb7022d9ce8447f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:40:15Z,use_quota=True,user_id='427be7d4eed44aeaa994646521a5c7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:40:15.663531 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c61bc17-81ea-4b15-85ab-7281c67c9e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:40:15.675741 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c61bc17-81ea-4b15-85ab-7281c67c9e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:40:15.689753 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e50d484-6627-41b2-b0fa-57f413bc3c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:40:15.890739 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e50d484-6627-41b2-b0fa-57f413bc3c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '023f6512-a5b6-488a-94da-4950eb9d53ca', 'volume_name': 'volume-023f6512-a5b6-488a-94da-4950eb9d53ca', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:40:15.907517 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb199ed-8e7d-4327-82c5-f39f11f12207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:40:15.931999 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb199ed-8e7d-4327-82c5-f39f11f12207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:40:15.942890 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9ad138-2f68-463c-ab3c-cf21c4432042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:40:15.951820 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Volume 023f6512-a5b6-488a-94da-4950eb9d53ca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-023f6512-a5b6-488a-94da-4950eb9d53ca', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:40:15.973065 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Cloning 023f6512-a5b6-488a-94da-4950eb9d53ca from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:40:15.997420 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.019s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:40:16.130316 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 40, 16, 12159)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:40:16.130316 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:40:16.130316 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:40:16.137633 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.145s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:40:16.138581 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:40:16.153367 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 40, 16, 143257)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:40:16.162504 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:40:16.163849 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:40:16.193078 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:17.048253 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] creating snapshot='volume-023f6512-a5b6-488a-94da-4950eb9d53ca.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:40:19.700617 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-023f6512-a5b6-488a-94da-4950eb9d53ca.clone_snap' to 'volume-023f6512-a5b6-488a-94da-4950eb9d53ca' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:40:22.154417 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:40:22.155515 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:40:22.155901 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:40:23.083052 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:40:23.084022 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Marking volume 023f6512-a5b6-488a-94da-4950eb9d53ca as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:40:23.178771 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 023f6512-a5b6-488a-94da-4950eb9d53ca. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:40:23.180730 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Creating volume glance metadata for volume 023f6512-a5b6-488a-94da-4950eb9d53ca backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:40:23.350721 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9ad138-2f68-463c-ab3c-cf21c4432042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023f6512-a5b6-488a-94da-4950eb9d53ca', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:40:23.358603 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f1b2d1-a28a-4444-859a-21b23e6ec065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:40:23.458822 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Volume volume-023f6512-a5b6-488a-94da-4950eb9d53ca (023f6512-a5b6-488a-94da-4950eb9d53ca): created successfully May 02 10:40:23.467193 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f1b2d1-a28a-4444-859a-21b23e6ec065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:40:23.474922 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Flow 'volume_create_manager' (448a1db6-5235-48d7-b813-4dc5c1cb893c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:40:23.580336 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-7d1588b4-3a8e-4214-9176-8ccc7dd38347 tempest-VolumesExtendTest-1474523646 None] Created volume successfully. May 02 10:40:24.951280 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-14b832b2-5f58-48ed-aa6e-5ba408b820c7 tempest-VolumesExtendTest-1474523646 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:27.618482 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-14b832b2-5f58-48ed-aa6e-5ba408b820c7 tempest-VolumesExtendTest-1474523646 None] Extend volume from 1 GB to 2 GB. {{(pid=123784) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1875}} May 02 10:40:27.831023 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-14b832b2-5f58-48ed-aa6e-5ba408b820c7 tempest-VolumesExtendTest-1474523646 None] Extend volume completed successfully. May 02 10:40:29.855848 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:40:29.921485 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Flow 'volume_create_manager' (ad2bf01a-d00f-48b8-91a4-e96994373512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:40:29.939344 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0e2d05-be90-4a93-bf3d-c2eb7b6c3f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:40:29.959904 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0e2d05-be90-4a93-bf3d-c2eb7b6c3f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-199176207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=707b9fe8-c924-4682-812a-628374b66580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da89947cbda467c9eb7022d9ce8447f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:40:30Z,use_quota=True,user_id='427be7d4eed44aeaa994646521a5c7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:40:29.967001 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cccb41-d133-4889-a639-b1d90c8c26dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:40:29.971878 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cccb41-d133-4889-a639-b1d90c8c26dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:40:29.979990 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe12e930-1192-403e-b1a9-f87e00205742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:40:29.985009 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe12e930-1192-403e-b1a9-f87e00205742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707b9fe8-c924-4682-812a-628374b66580', 'volume_name': 'volume-707b9fe8-c924-4682-812a-628374b66580', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:40:29.995445 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09afa634-bcbb-4186-a391-c68f28f956ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:40:30.006563 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09afa634-bcbb-4186-a391-c68f28f956ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:40:30.019902 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9982ed0a-ee02-4de7-9168-7928dbbed9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:40:30.019902 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Volume 707b9fe8-c924-4682-812a-628374b66580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707b9fe8-c924-4682-812a-628374b66580', 'volume_size': 1} May 02 10:40:30.019902 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] creating volume 'volume-707b9fe8-c924-4682-812a-628374b66580' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:40:30.019902 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:31.125349 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:40:31.127322 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:40:31.133999 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9982ed0a-ee02-4de7-9168-7928dbbed9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707b9fe8-c924-4682-812a-628374b66580', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:40:31.140131 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c1aac9-20ec-41ff-96af-c1225b63019f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:40:31.224549 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Volume volume-707b9fe8-c924-4682-812a-628374b66580 (707b9fe8-c924-4682-812a-628374b66580): created successfully May 02 10:40:31.229664 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c1aac9-20ec-41ff-96af-c1225b63019f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:40:31.235379 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Flow 'volume_create_manager' (ad2bf01a-d00f-48b8-91a4-e96994373512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:40:31.362795 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-bdaa9d25-7c79-4ef3-bce5-8737de4b0c15 tempest-VolumesExtendTest-1474523646 None] Created volume successfully. May 02 10:40:32.663437 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5d411846-57e9-4cc9-82fb-f6c513a068b1 tempest-VolumesExtendTest-1474523646 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:37.624885 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5d411846-57e9-4cc9-82fb-f6c513a068b1 tempest-VolumesExtendTest-1474523646 None] Create snapshot completed successfully May 02 10:40:38.357518 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4935d42e-d384-4658-bcda-fdc670a82cbf tempest-VolumesExtendTest-1474523646 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:41.633779 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4935d42e-d384-4658-bcda-fdc670a82cbf tempest-VolumesExtendTest-1474523646 None] Extend volume from 1 GB to 2 GB. {{(pid=123784) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1875}} May 02 10:40:41.859262 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4935d42e-d384-4658-bcda-fdc670a82cbf tempest-VolumesExtendTest-1474523646 None] Extend volume completed successfully. May 02 10:40:43.180418 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-50c09004-9709-4d5a-a6ae-59567428a617 tempest-VolumesExtendTest-1474523646 None] Lock "b'cinder-efde9040-b6a2-435c-bccc-4767a1ac6798-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.024s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:40:43.182625 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-50c09004-9709-4d5a-a6ae-59567428a617 tempest-VolumesExtendTest-1474523646 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:47.957317 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-50c09004-9709-4d5a-a6ae-59567428a617 tempest-VolumesExtendTest-1474523646 None] Created reservations ['17e71a57-9698-49d0-b63a-772f06e69575', '4fbbbaec-aa5a-45bc-98f2-58ef0adbff35', 'cc06b350-a558-4443-9d93-8376a75597de', 'c4db26c6-fe31-46c3-b86a-1ed114727ba3'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:40:48.193413 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-50c09004-9709-4d5a-a6ae-59567428a617 tempest-VolumesExtendTest-1474523646 None] Delete snapshot completed successfully. May 02 10:40:48.202406 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-50c09004-9709-4d5a-a6ae-59567428a617 tempest-VolumesExtendTest-1474523646 None] Lock "b'cinder-efde9040-b6a2-435c-bccc-4767a1ac6798-delete_snapshot'" released by "delete_snapshot" :: held 5.020s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:40:49.285035 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a9e7a9ce-ce47-4ade-b59f-979fe87b29f8 tempest-VolumesExtendTest-1474523646 None] Lock "b'cinder-707b9fe8-c924-4682-812a-628374b66580-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:40:49.509088 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a9e7a9ce-ce47-4ade-b59f-979fe87b29f8 tempest-VolumesExtendTest-1474523646 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:49.805802 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a9e7a9ce-ce47-4ade-b59f-979fe87b29f8 tempest-VolumesExtendTest-1474523646 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:40:49.806638 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a9e7a9ce-ce47-4ade-b59f-979fe87b29f8 tempest-VolumesExtendTest-1474523646 None] Volume volume-707b9fe8-c924-4682-812a-628374b66580 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:40:50.122490 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a9e7a9ce-ce47-4ade-b59f-979fe87b29f8 tempest-VolumesExtendTest-1474523646 None] deleting rbd volume volume-707b9fe8-c924-4682-812a-628374b66580 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:40:58.760818 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:40:58.765192 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:58.944687 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:58.991496 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:40:58.996557 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-a9e7a9ce-ce47-4ade-b59f-979fe87b29f8 tempest-VolumesExtendTest-1474523646 None] Created reservations ['1642ba56-b49f-44f8-a2ee-9de220e54522', 'fda606f9-ffa7-4c63-a4ae-d65d04a3a12a', '133b903c-a711-4bd9-9e66-6c52b6c6a21c', 'e0d951f2-bb66-4f34-a8f7-521b4eabcd55'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:40:59.292925 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a9e7a9ce-ce47-4ade-b59f-979fe87b29f8 tempest-VolumesExtendTest-1474523646 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:59.382349 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a9e7a9ce-ce47-4ade-b59f-979fe87b29f8 tempest-VolumesExtendTest-1474523646 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:40:59.447867 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-a9e7a9ce-ce47-4ade-b59f-979fe87b29f8 tempest-VolumesExtendTest-1474523646 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:40:59.452174 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a9e7a9ce-ce47-4ade-b59f-979fe87b29f8 tempest-VolumesExtendTest-1474523646 None] Deleted volume successfully. May 02 10:40:59.565552 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a9e7a9ce-ce47-4ade-b59f-979fe87b29f8 tempest-VolumesExtendTest-1474523646 None] Lock "b'cinder-707b9fe8-c924-4682-812a-628374b66580-delete_volume'" released by "delete_volume" :: held 10.282s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:40:59.572639 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a8324ff7-3d0c-4cc9-99a4-ba795b911180 tempest-VolumesExtendTest-1474523646 None] Lock "b'cinder-023f6512-a5b6-488a-94da-4950eb9d53ca-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:40:59.797404 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a8324ff7-3d0c-4cc9-99a4-ba795b911180 tempest-VolumesExtendTest-1474523646 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:41:00.057445 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a8324ff7-3d0c-4cc9-99a4-ba795b911180 tempest-VolumesExtendTest-1474523646 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:41:00.313582 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a8324ff7-3d0c-4cc9-99a4-ba795b911180 tempest-VolumesExtendTest-1474523646 None] deleting rbd volume volume-023f6512-a5b6-488a-94da-4950eb9d53ca {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:41:09.251283 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a8324ff7-3d0c-4cc9-99a4-ba795b911180 tempest-VolumesExtendTest-1474523646 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:41:09.546193 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a8324ff7-3d0c-4cc9-99a4-ba795b911180 tempest-VolumesExtendTest-1474523646 None] deleting parent snapshot volume-023f6512-a5b6-488a-94da-4950eb9d53ca.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:41:14.673964 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-a8324ff7-3d0c-4cc9-99a4-ba795b911180 tempest-VolumesExtendTest-1474523646 None] Created reservations ['ef10b7d7-ccf0-4c73-8176-b23393a3aaa9', 'aaa6a679-7269-4087-a755-3d061b9aa02e', 'b480f027-12a6-4db0-91f4-c2d4e06ad9c4', 'fea68d84-dba3-46d2-b46a-3dccecec828c'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:41:14.893980 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a8324ff7-3d0c-4cc9-99a4-ba795b911180 tempest-VolumesExtendTest-1474523646 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:41:14.949286 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a8324ff7-3d0c-4cc9-99a4-ba795b911180 tempest-VolumesExtendTest-1474523646 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:41:15.011019 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-a8324ff7-3d0c-4cc9-99a4-ba795b911180 tempest-VolumesExtendTest-1474523646 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:41:15.019174 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a8324ff7-3d0c-4cc9-99a4-ba795b911180 tempest-VolumesExtendTest-1474523646 None] Deleted volume successfully. May 02 10:41:15.120023 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a8324ff7-3d0c-4cc9-99a4-ba795b911180 tempest-VolumesExtendTest-1474523646 None] Lock "b'cinder-023f6512-a5b6-488a-94da-4950eb9d53ca-delete_volume'" released by "delete_volume" :: held 15.544s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:41:19.398340 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:41:19.421855 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Flow 'volume_create_manager' (aeeac069-cfdc-4a54-abe9-435a017b74a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:41:19.430207 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b82d8de-409e-419d-a8b4-237f543636e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:41:19.456325 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b82d8de-409e-419d-a8b4-237f543636e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1803906796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3d64ebc8-3830-4a8b-80e0-457125a3ccef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23c327323ab84febaef036ab6c72b1e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:41:19Z,use_quota=True,user_id='fe7b70a089c440d98bec17a6f1499a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:41:19.462078 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680c1398-ec71-440c-971e-c1fd2dfe146c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:41:19.466449 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680c1398-ec71-440c-971e-c1fd2dfe146c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:41:19.471759 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7dfccf-51f9-4fc3-a746-97c79c22f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:41:19.476785 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7dfccf-51f9-4fc3-a746-97c79c22f053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d64ebc8-3830-4a8b-80e0-457125a3ccef', 'volume_name': 'volume-3d64ebc8-3830-4a8b-80e0-457125a3ccef', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:41:19.482091 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2e6904-da6c-47cf-bfda-3304462fd0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:41:19.486314 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2e6904-da6c-47cf-bfda-3304462fd0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:41:19.492030 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5cfc83-367e-4b58-97ed-0528f1b190a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:41:19.493327 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Volume 3d64ebc8-3830-4a8b-80e0-457125a3ccef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d64ebc8-3830-4a8b-80e0-457125a3ccef', 'volume_size': 1} May 02 10:41:19.493816 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] creating volume 'volume-3d64ebc8-3830-4a8b-80e0-457125a3ccef' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:41:19.494745 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:41:20.567928 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:41:20.568566 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:41:20.572860 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5cfc83-367e-4b58-97ed-0528f1b190a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d64ebc8-3830-4a8b-80e0-457125a3ccef', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:41:20.577456 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea9da4c-1ae8-49af-beb3-c61541a7ee43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:41:20.639041 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Volume volume-3d64ebc8-3830-4a8b-80e0-457125a3ccef (3d64ebc8-3830-4a8b-80e0-457125a3ccef): created successfully May 02 10:41:20.643128 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea9da4c-1ae8-49af-beb3-c61541a7ee43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:41:20.650006 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Flow 'volume_create_manager' (aeeac069-cfdc-4a54-abe9-435a017b74a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:41:20.747595 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-50b9fbac-ce08-4fca-b97f-848084376578 tempest-VolumesNegativeTest-1297421299 None] Created volume successfully. May 02 10:41:50.531364 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-2fbc4ed5-3312-4a5b-bbb9-954f2a86e4d0 tempest-VolumesNegativeTest-1297421299 None] Lock "b'cinder-3d64ebc8-3830-4a8b-80e0-457125a3ccef-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:41:50.664536 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2fbc4ed5-3312-4a5b-bbb9-954f2a86e4d0 tempest-VolumesNegativeTest-1297421299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:41:51.020684 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2fbc4ed5-3312-4a5b-bbb9-954f2a86e4d0 tempest-VolumesNegativeTest-1297421299 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:41:51.020684 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2fbc4ed5-3312-4a5b-bbb9-954f2a86e4d0 tempest-VolumesNegativeTest-1297421299 None] Volume volume-3d64ebc8-3830-4a8b-80e0-457125a3ccef is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:41:51.441839 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2fbc4ed5-3312-4a5b-bbb9-954f2a86e4d0 tempest-VolumesNegativeTest-1297421299 None] deleting rbd volume volume-3d64ebc8-3830-4a8b-80e0-457125a3ccef {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:41:58.763630 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:41:58.768810 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:41:58.853642 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:41:59.002288 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:41:59.627958 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-2fbc4ed5-3312-4a5b-bbb9-954f2a86e4d0 tempest-VolumesNegativeTest-1297421299 None] Created reservations ['e16e4727-26c3-4ebf-9110-80feea4db4b3', '2897ebb8-c4c5-474a-97c6-126c54989df5', '31f32856-0818-485e-81ff-1ec6681a860c', '48114330-a4be-444a-9ae7-f87eca6b970a'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:41:59.833793 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2fbc4ed5-3312-4a5b-bbb9-954f2a86e4d0 tempest-VolumesNegativeTest-1297421299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:41:59.885515 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2fbc4ed5-3312-4a5b-bbb9-954f2a86e4d0 tempest-VolumesNegativeTest-1297421299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:41:59.946872 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-2fbc4ed5-3312-4a5b-bbb9-954f2a86e4d0 tempest-VolumesNegativeTest-1297421299 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:41:59.958367 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2fbc4ed5-3312-4a5b-bbb9-954f2a86e4d0 tempest-VolumesNegativeTest-1297421299 None] Deleted volume successfully. May 02 10:42:00.094254 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-2fbc4ed5-3312-4a5b-bbb9-954f2a86e4d0 tempest-VolumesNegativeTest-1297421299 None] Lock "b'cinder-3d64ebc8-3830-4a8b-80e0-457125a3ccef-delete_volume'" released by "delete_volume" :: held 9.563s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:42:17.400082 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5a965aca-b08c-42fe-9001-e21116f78472 tempest-GroupSnapshotsV319Test-1674757491 None] Group tempest-GroupSnapshotsV319Test-Group-66848045: creating May 02 10:42:17.648844 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5a965aca-b08c-42fe-9001-e21116f78472 tempest-GroupSnapshotsV319Test-1674757491 None] Group tempest-GroupSnapshotsV319Test-Group-66848045: created successfully May 02 10:42:17.658830 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5a965aca-b08c-42fe-9001-e21116f78472 tempest-GroupSnapshotsV319Test-1674757491 None] Create group completed successfully. May 02 10:42:19.330535 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:42:19.351350 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Flow 'volume_create_manager' (f4a104d5-94f8-4c8d-a074-d56a2e981fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:42:19.357917 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5ef51e-64d1-45f3-b7cf-2bf85e5b88fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:42:19.372722 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5ef51e-64d1-45f3-b7cf-2bf85e5b88fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-1559624329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6bdff527-9480-40c5-8c57-460395718f09,host='ncdv-master-1@ceph#ceph',id=735f629d-3adb-4d47-911c-cc5c537fa460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03cbe7924e22488b92979871106a3ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:42:19Z,use_quota=True,user_id='5ced847d8ea7448aab8de7a3bbc72c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5633a6c6-4540-4459-966c-acd9d9fb030a),volume_type_id=5633a6c6-4540-4459-966c-acd9d9fb030a)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:42:19.378500 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86d8136-9814-4723-87f0-c24cb9914b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:42:19.382687 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86d8136-9814-4723-87f0-c24cb9914b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:42:19.388327 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e35a99-501e-48cc-bba7-5137f9c6c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:42:19.394546 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e35a99-501e-48cc-bba7-5137f9c6c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '735f629d-3adb-4d47-911c-cc5c537fa460', 'volume_name': 'volume-735f629d-3adb-4d47-911c-cc5c537fa460', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:42:19.400393 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bbe06b-856b-45ef-8ef1-e0f20445a145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:42:19.405251 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bbe06b-856b-45ef-8ef1-e0f20445a145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:42:19.412037 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a4e561-ca0b-4607-a027-83b03cc8123a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:42:19.413559 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Volume 735f629d-3adb-4d47-911c-cc5c537fa460: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-735f629d-3adb-4d47-911c-cc5c537fa460', 'volume_size': 1} May 02 10:42:19.413957 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] creating volume 'volume-735f629d-3adb-4d47-911c-cc5c537fa460' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:42:19.414727 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:42:20.640751 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:42:20.641560 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:42:20.645762 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a4e561-ca0b-4607-a027-83b03cc8123a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735f629d-3adb-4d47-911c-cc5c537fa460', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:42:20.650507 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e7928b-c365-45f8-a191-62100f3f55f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:42:20.740233 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Volume volume-735f629d-3adb-4d47-911c-cc5c537fa460 (735f629d-3adb-4d47-911c-cc5c537fa460): created successfully May 02 10:42:20.743992 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e7928b-c365-45f8-a191-62100f3f55f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:42:20.749687 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Flow 'volume_create_manager' (f4a104d5-94f8-4c8d-a074-d56a2e981fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:42:20.825942 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-ee1227a8-4a89-49fc-93a7-42f8c04a78d5 tempest-GroupSnapshotsV319Test-1674757491 None] Created volume successfully. May 02 10:42:21.881777 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-37229f38-ca78-4f2b-84e3-a7d67788a214 tempest-GroupSnapshotsV319Test-1674757491 None] GroupSnapshot 27f085d4-d30d-4ed4-9b2e-2cf45932e9aa: creating. May 02 10:42:21.914912 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-37229f38-ca78-4f2b-84e3-a7d67788a214 tempest-GroupSnapshotsV319Test-1674757491 None] Group snapshot 27f085d4-d30d-4ed4-9b2e-2cf45932e9aa: creating. {{(pid=123784) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} May 02 10:42:21.929996 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-37229f38-ca78-4f2b-84e3-a7d67788a214 tempest-GroupSnapshotsV319Test-1674757491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:42:26.080214 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-37229f38-ca78-4f2b-84e3-a7d67788a214 tempest-GroupSnapshotsV319Test-1674757491 None] group_snapshot 27f085d4-d30d-4ed4-9b2e-2cf45932e9aa: created successfully May 02 10:42:27.863952 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5c11d9c4-4a8e-4081-abf5-f0a38e37e98f tempest-GroupSnapshotsV319Test-1674757491 None] group_snapshot 27f085d4-d30d-4ed4-9b2e-2cf45932e9aa: deleting May 02 10:42:27.879660 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5c11d9c4-4a8e-4081-abf5-f0a38e37e98f tempest-GroupSnapshotsV319Test-1674757491 None] group_snapshot 27f085d4-d30d-4ed4-9b2e-2cf45932e9aa: deleting {{(pid=123784) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} May 02 10:42:27.896272 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5c11d9c4-4a8e-4081-abf5-f0a38e37e98f tempest-GroupSnapshotsV319Test-1674757491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:42:32.157573 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-5c11d9c4-4a8e-4081-abf5-f0a38e37e98f tempest-GroupSnapshotsV319Test-1674757491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1257821690 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1257821690, it is now deprecated. Please use the default quota class for default quota. May 02 10:42:32.158507 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-5c11d9c4-4a8e-4081-abf5-f0a38e37e98f tempest-GroupSnapshotsV319Test-1674757491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1257821690 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1257821690, it is now deprecated. Please use the default quota class for default quota. May 02 10:42:32.259977 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-5c11d9c4-4a8e-4081-abf5-f0a38e37e98f tempest-GroupSnapshotsV319Test-1674757491 None] Created reservations ['4f1e9145-40ea-4922-a453-e71c70bf4d1c', '8a71f989-a1d0-478a-b6f0-685fad8d0bfb', 'ee579101-3ec4-4c1f-87d4-5b0cf7a69e14', '75ec0d7c-06e6-45a6-b058-abedc455ba6b'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:42:32.633811 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5c11d9c4-4a8e-4081-abf5-f0a38e37e98f tempest-GroupSnapshotsV319Test-1674757491 None] group_snapshot 27f085d4-d30d-4ed4-9b2e-2cf45932e9aa: deleted successfully May 02 10:42:33.543765 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-374640eb-49d1-4198-bf51-46d77e2c9e31 tempest-GroupSnapshotsV319Test-1674757491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:42:33.759258 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-374640eb-49d1-4198-bf51-46d77e2c9e31 tempest-GroupSnapshotsV319Test-1674757491 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:42:33.759709 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-374640eb-49d1-4198-bf51-46d77e2c9e31 tempest-GroupSnapshotsV319Test-1674757491 None] Volume volume-735f629d-3adb-4d47-911c-cc5c537fa460 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:42:34.010294 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-374640eb-49d1-4198-bf51-46d77e2c9e31 tempest-GroupSnapshotsV319Test-1674757491 None] deleting rbd volume volume-735f629d-3adb-4d47-911c-cc5c537fa460 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:42:42.865163 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-374640eb-49d1-4198-bf51-46d77e2c9e31 tempest-GroupSnapshotsV319Test-1674757491 None] Created reservations ['1fb65a14-f9ae-4fd4-a205-a8587e1fef90'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:42:42.886135 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-374640eb-49d1-4198-bf51-46d77e2c9e31 tempest-GroupSnapshotsV319Test-1674757491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1257821690 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1257821690, it is now deprecated. Please use the default quota class for default quota. May 02 10:42:42.992065 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-374640eb-49d1-4198-bf51-46d77e2c9e31 tempest-GroupSnapshotsV319Test-1674757491 None] Created reservations ['ed4a59b2-ea98-43b9-a801-109e1fcbc2a6', '2200f3ba-8f6a-4b9b-9ea4-0940907e68a5', '4f083ca5-4d10-4676-877e-a7b37a71d307', '68bddf1b-27dd-4e09-a030-284cbea6143b'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:42:43.414941 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-374640eb-49d1-4198-bf51-46d77e2c9e31 tempest-GroupSnapshotsV319Test-1674757491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:42:43.451325 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-374640eb-49d1-4198-bf51-46d77e2c9e31 tempest-GroupSnapshotsV319Test-1674757491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:42:43.526883 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-374640eb-49d1-4198-bf51-46d77e2c9e31 tempest-GroupSnapshotsV319Test-1674757491 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:42:43.531610 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-374640eb-49d1-4198-bf51-46d77e2c9e31 tempest-GroupSnapshotsV319Test-1674757491 None] Delete group completed successfully. May 02 10:42:52.753682 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e5f7b3f5-6a23-4fe8-a340-20797881c274 tempest-GroupsTest-1271137687 None] Group tempest-Group1-1361783108: creating May 02 10:42:52.851244 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e5f7b3f5-6a23-4fe8-a340-20797881c274 tempest-GroupsTest-1271137687 None] Group tempest-Group1-1361783108: created successfully May 02 10:42:52.883075 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e5f7b3f5-6a23-4fe8-a340-20797881c274 tempest-GroupsTest-1271137687 None] Create group completed successfully. May 02 10:42:54.570650 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3d618314-4fc3-4bb5-9bfe-4b9fd484d9e5 tempest-GroupsTest-1271137687 None] Group tempest-Group2-1652783529: creating May 02 10:42:54.749725 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3d618314-4fc3-4bb5-9bfe-4b9fd484d9e5 tempest-GroupsTest-1271137687 None] Group tempest-Group2-1652783529: created successfully May 02 10:42:54.774750 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3d618314-4fc3-4bb5-9bfe-4b9fd484d9e5 tempest-GroupsTest-1271137687 None] Create group completed successfully. May 02 10:42:56.716351 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:42:56.740173 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Flow 'volume_create_manager' (9c41bb32-9b3b-4f21-b135-5f662b443b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:42:56.747166 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbaa69b-28f8-4cea-9b2f-81d9b5b58c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:42:56.764369 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbaa69b-28f8-4cea-9b2f-81d9b5b58c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-945276366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b915dbb-750f-4c4f-a391-3822723af536,host='ncdv-master-1@ceph#ceph',id=7b4fdea0-83f4-45f2-8c74-9a37b02f35a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40050853f73b4da6a3720799307dded5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:42:57Z,use_quota=True,user_id='9e063a35d92e45a5808790d6eb4f33dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(790b437e-d097-4b17-b513-8c525ecc72ca),volume_type_id=790b437e-d097-4b17-b513-8c525ecc72ca)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:42:56.770035 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49e321d-75f3-4139-bf71-a5df8a776d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:42:56.774961 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49e321d-75f3-4139-bf71-a5df8a776d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:42:56.780157 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a636d7e1-a6c5-45d2-9f1e-5e1d7e270dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:42:56.784481 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a636d7e1-a6c5-45d2-9f1e-5e1d7e270dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4fdea0-83f4-45f2-8c74-9a37b02f35a6', 'volume_name': 'volume-7b4fdea0-83f4-45f2-8c74-9a37b02f35a6', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:42:56.790201 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a42722-dc70-40bd-b3d4-cbf26ded40b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:42:56.794213 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a42722-dc70-40bd-b3d4-cbf26ded40b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:42:56.799082 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536c58c1-472c-4118-97cd-a57b37d43ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:42:56.800230 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Volume 7b4fdea0-83f4-45f2-8c74-9a37b02f35a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4fdea0-83f4-45f2-8c74-9a37b02f35a6', 'volume_size': 1} May 02 10:42:56.800635 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] creating volume 'volume-7b4fdea0-83f4-45f2-8c74-9a37b02f35a6' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:42:56.801397 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:42:56.869165 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-da3bea68-03b2-472f-8311-6e1c9926637f req-d1b81be6-deb7-4ea2-a9db-4f17273a4b1a tempest-TaggedBootDevicesTest-94249343 None] Terminate volume connection completed successfully. May 02 10:42:56.869165 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-da3bea68-03b2-472f-8311-6e1c9926637f req-d1b81be6-deb7-4ea2-a9db-4f17273a4b1a tempest-TaggedBootDevicesTest-94249343 None] Deleting attachment 062ac103-254b-4569-bc4c-ec808aa18b8b. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:42:57.090878 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-da3bea68-03b2-472f-8311-6e1c9926637f req-2ef48a75-3e04-4f3c-b081-ed7ea385da65 tempest-TaggedBootDevicesTest-94249343 None] Terminate volume connection completed successfully. May 02 10:42:57.091217 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-da3bea68-03b2-472f-8311-6e1c9926637f req-2ef48a75-3e04-4f3c-b081-ed7ea385da65 tempest-TaggedBootDevicesTest-94249343 None] Deleting attachment b34629fb-0c14-4370-a2c0-783c6a2db4c1. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:42:57.326095 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-da3bea68-03b2-472f-8311-6e1c9926637f req-37fcefa6-8a22-4a68-abd1-3587dcfcdcff tempest-TaggedBootDevicesTest-94249343 None] Terminate volume connection completed successfully. May 02 10:42:57.327524 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-da3bea68-03b2-472f-8311-6e1c9926637f req-37fcefa6-8a22-4a68-abd1-3587dcfcdcff tempest-TaggedBootDevicesTest-94249343 None] Deleting attachment 6cda1646-ca1c-4812-8a96-5cf9fe2719ba. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:42:57.896387 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:42:57.897072 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:42:57.900564 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536c58c1-472c-4118-97cd-a57b37d43ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4fdea0-83f4-45f2-8c74-9a37b02f35a6', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:42:57.905326 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4aaf775-491a-4fcf-a501-d098032fe43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:42:58.002208 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Volume volume-7b4fdea0-83f4-45f2-8c74-9a37b02f35a6 (7b4fdea0-83f4-45f2-8c74-9a37b02f35a6): created successfully May 02 10:42:58.006184 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4aaf775-491a-4fcf-a501-d098032fe43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:42:58.011896 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Flow 'volume_create_manager' (9c41bb32-9b3b-4f21-b135-5f662b443b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:42:58.156097 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-30c4ba09-b9aa-42d4-a985-1b8a10375269 tempest-GroupsTest-1271137687 None] Created volume successfully. May 02 10:42:58.768881 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:42:58.769604 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:42:58.793466 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:42:58.819384 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:42:59.237726 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e0ae3c27-bbf1-477b-bbec-8f75c11e98ba tempest-GroupsTest-1271137687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:42:59.448948 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e0ae3c27-bbf1-477b-bbec-8f75c11e98ba tempest-GroupsTest-1271137687 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:42:59.449484 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e0ae3c27-bbf1-477b-bbec-8f75c11e98ba tempest-GroupsTest-1271137687 None] Volume volume-7b4fdea0-83f4-45f2-8c74-9a37b02f35a6 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:42:59.782358 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e0ae3c27-bbf1-477b-bbec-8f75c11e98ba tempest-GroupsTest-1271137687 None] deleting rbd volume volume-7b4fdea0-83f4-45f2-8c74-9a37b02f35a6 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:43:04.821986 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-702814eb-b78d-4f3c-b478-79301fb2bc73 tempest-TaggedBootDevicesTest-94249343 None] Lock "b'cinder-79fcb3f4-38e9-4ce5-9872-fe92fc99d572-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:43:04.933531 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-702814eb-b78d-4f3c-b478-79301fb2bc73 tempest-TaggedBootDevicesTest-94249343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:05.101944 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-702814eb-b78d-4f3c-b478-79301fb2bc73 tempest-TaggedBootDevicesTest-94249343 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:43:05.102279 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-702814eb-b78d-4f3c-b478-79301fb2bc73 tempest-TaggedBootDevicesTest-94249343 None] Volume volume-79fcb3f4-38e9-4ce5-9872-fe92fc99d572 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:43:05.369888 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-702814eb-b78d-4f3c-b478-79301fb2bc73 tempest-TaggedBootDevicesTest-94249343 None] deleting rbd volume volume-79fcb3f4-38e9-4ce5-9872-fe92fc99d572 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:43:07.510036 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-e0ae3c27-bbf1-477b-bbec-8f75c11e98ba tempest-GroupsTest-1271137687 None] Created reservations ['8e71f324-d9c4-428e-8756-1005f824ac47'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:43:07.526960 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-e0ae3c27-bbf1-477b-bbec-8f75c11e98ba tempest-GroupsTest-1271137687 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-498286906 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-498286906, it is now deprecated. Please use the default quota class for default quota. May 02 10:43:07.527875 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-e0ae3c27-bbf1-477b-bbec-8f75c11e98ba tempest-GroupsTest-1271137687 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-498286906 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-498286906, it is now deprecated. Please use the default quota class for default quota. May 02 10:43:07.601893 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-e0ae3c27-bbf1-477b-bbec-8f75c11e98ba tempest-GroupsTest-1271137687 None] Created reservations ['0d4669ad-acc1-40bb-a58f-d770505a1911', 'e75085ab-93b1-4cfd-86f2-2f286c6bffcd', 'ac62c69b-cddc-4bc1-b5cd-299dc1a486d9', '4e214b43-d896-4830-b698-f4e73716694f'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:43:07.962380 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e0ae3c27-bbf1-477b-bbec-8f75c11e98ba tempest-GroupsTest-1271137687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:08.017915 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e0ae3c27-bbf1-477b-bbec-8f75c11e98ba tempest-GroupsTest-1271137687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:08.138322 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-e0ae3c27-bbf1-477b-bbec-8f75c11e98ba tempest-GroupsTest-1271137687 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:43:08.143345 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e0ae3c27-bbf1-477b-bbec-8f75c11e98ba tempest-GroupsTest-1271137687 None] Delete group completed successfully. May 02 10:43:08.321712 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-2b6f6d52-d2f8-457b-b780-25939ddcb94e tempest-GroupsTest-1271137687 None] Created reservations ['80c3285d-00de-4808-9d57-85248a834326'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:43:08.467541 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b6f6d52-d2f8-457b-b780-25939ddcb94e tempest-GroupsTest-1271137687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:08.493267 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b6f6d52-d2f8-457b-b780-25939ddcb94e tempest-GroupsTest-1271137687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:08.517607 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-2b6f6d52-d2f8-457b-b780-25939ddcb94e tempest-GroupsTest-1271137687 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:43:08.521369 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2b6f6d52-d2f8-457b-b780-25939ddcb94e tempest-GroupsTest-1271137687 None] Delete group completed successfully. May 02 10:43:10.389253 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a4d0abd3-7b09-4edb-8e7f-f0669bb109c8 tempest-GroupsTest-1271137687 None] Group tempest-GroupsTest-Group-480754346: creating May 02 10:43:10.444227 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a4d0abd3-7b09-4edb-8e7f-f0669bb109c8 tempest-GroupsTest-1271137687 None] Group tempest-GroupsTest-Group-480754346: created successfully May 02 10:43:10.454140 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a4d0abd3-7b09-4edb-8e7f-f0669bb109c8 tempest-GroupsTest-1271137687 None] Create group completed successfully. May 02 10:43:12.586459 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:43:12.606381 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Flow 'volume_create_manager' (163e9abf-694a-4a20-a567-3a1838e7d29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:43:12.612803 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea4c00e-122a-428e-b65b-1a9eb0569c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:43:12.634794 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea4c00e-122a-428e-b65b-1a9eb0569c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-814107234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8890f2bb-4329-48b9-8dff-73b465ed5552,host='ncdv-master-1@ceph#ceph',id=d3059e64-de85-4d44-855c-4592b7bf1b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40050853f73b4da6a3720799307dded5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:43:12Z,use_quota=True,user_id='9e063a35d92e45a5808790d6eb4f33dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1202438-8d16-4a64-bba7-9f6ee50c6b42),volume_type_id=f1202438-8d16-4a64-bba7-9f6ee50c6b42)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:43:12.640268 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a343952e-d213-4831-8292-27a77451d6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:43:12.644461 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a343952e-d213-4831-8292-27a77451d6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:43:12.650233 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f86921-1fd5-4781-a1f1-ac229b39f1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:43:12.654377 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f86921-1fd5-4781-a1f1-ac229b39f1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3059e64-de85-4d44-855c-4592b7bf1b36', 'volume_name': 'volume-d3059e64-de85-4d44-855c-4592b7bf1b36', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:43:12.659414 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c0a61a-61b7-4b63-b644-45f0705037e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:43:12.663911 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c0a61a-61b7-4b63-b644-45f0705037e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:43:12.668715 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c91e081b-cd71-4e18-bed5-d5b704170505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:43:12.670449 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Volume d3059e64-de85-4d44-855c-4592b7bf1b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3059e64-de85-4d44-855c-4592b7bf1b36', 'volume_size': 1} May 02 10:43:12.670449 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] creating volume 'volume-d3059e64-de85-4d44-855c-4592b7bf1b36' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:43:12.670951 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:12.808392 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-702814eb-b78d-4f3c-b478-79301fb2bc73 tempest-TaggedBootDevicesTest-94249343 None] Created reservations ['78016199-139f-4c49-8aec-1d2a781c8c5e', '3f024fda-7e7b-4920-8799-89959aebf220', 'fad0d9fe-27dc-4ecc-bad7-712e989feb55', 'f4f3b985-3671-4a39-ba90-cd2984896aee'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:43:12.992316 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-702814eb-b78d-4f3c-b478-79301fb2bc73 tempest-TaggedBootDevicesTest-94249343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:13.015480 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-702814eb-b78d-4f3c-b478-79301fb2bc73 tempest-TaggedBootDevicesTest-94249343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:13.039504 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-702814eb-b78d-4f3c-b478-79301fb2bc73 tempest-TaggedBootDevicesTest-94249343 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:43:13.044109 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-702814eb-b78d-4f3c-b478-79301fb2bc73 tempest-TaggedBootDevicesTest-94249343 None] Deleted volume successfully. May 02 10:43:13.130740 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-702814eb-b78d-4f3c-b478-79301fb2bc73 tempest-TaggedBootDevicesTest-94249343 None] Lock "b'cinder-79fcb3f4-38e9-4ce5-9872-fe92fc99d572-delete_volume'" released by "delete_volume" :: held 8.308s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:43:13.467562 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-005f87a5-d46e-41c3-9bda-044cf1dfd803 tempest-TaggedBootDevicesTest-94249343 None] Lock "b'cinder-6f534bd2-f64f-401c-9854-a30e90688a18-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:43:13.559938 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-005f87a5-d46e-41c3-9bda-044cf1dfd803 tempest-TaggedBootDevicesTest-94249343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:13.909917 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-005f87a5-d46e-41c3-9bda-044cf1dfd803 tempest-TaggedBootDevicesTest-94249343 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:43:13.910528 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-005f87a5-d46e-41c3-9bda-044cf1dfd803 tempest-TaggedBootDevicesTest-94249343 None] Volume volume-6f534bd2-f64f-401c-9854-a30e90688a18 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:43:14.216355 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-005f87a5-d46e-41c3-9bda-044cf1dfd803 tempest-TaggedBootDevicesTest-94249343 None] deleting rbd volume volume-6f534bd2-f64f-401c-9854-a30e90688a18 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:43:14.228185 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:43:14.228673 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:43:14.232435 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c91e081b-cd71-4e18-bed5-d5b704170505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3059e64-de85-4d44-855c-4592b7bf1b36', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:43:14.237867 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80696a6e-0002-4f7a-9c7d-3129d8c67a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:43:14.326604 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Volume volume-d3059e64-de85-4d44-855c-4592b7bf1b36 (d3059e64-de85-4d44-855c-4592b7bf1b36): created successfully May 02 10:43:14.333272 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80696a6e-0002-4f7a-9c7d-3129d8c67a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:43:14.340965 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Flow 'volume_create_manager' (163e9abf-694a-4a20-a567-3a1838e7d29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:43:14.453384 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b4d491e4-bc50-4c70-90ac-da50124913e9 tempest-GroupsTest-1271137687 None] Created volume successfully. May 02 10:43:15.494554 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:43:15.513905 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Flow 'volume_create_manager' (778bc461-8714-429b-830a-e7e23e850513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:43:15.521484 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659bec3a-e01e-4385-a0a3-57ca296a23bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:43:15.543427 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659bec3a-e01e-4385-a0a3-57ca296a23bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-80332988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8890f2bb-4329-48b9-8dff-73b465ed5552,host='ncdv-master-1@ceph#ceph',id=0ac9460f-f823-4a1c-92b0-7d330c026312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40050853f73b4da6a3720799307dded5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:43:15Z,use_quota=True,user_id='9e063a35d92e45a5808790d6eb4f33dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1202438-8d16-4a64-bba7-9f6ee50c6b42),volume_type_id=f1202438-8d16-4a64-bba7-9f6ee50c6b42)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:43:15.549014 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560f5bc5-681f-47ff-949f-ee3347d50c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:43:15.553628 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560f5bc5-681f-47ff-949f-ee3347d50c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:43:15.560429 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae6b54d-7e46-4bc9-95c8-c1c89fe41d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:43:15.564930 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae6b54d-7e46-4bc9-95c8-c1c89fe41d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac9460f-f823-4a1c-92b0-7d330c026312', 'volume_name': 'volume-0ac9460f-f823-4a1c-92b0-7d330c026312', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:43:15.570287 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5739e9a6-aed4-4a64-a927-84d32d7944fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:43:15.574206 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5739e9a6-aed4-4a64-a927-84d32d7944fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:43:15.579121 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8573782c-1d46-4848-987d-20a606956a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:43:15.580273 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Volume 0ac9460f-f823-4a1c-92b0-7d330c026312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac9460f-f823-4a1c-92b0-7d330c026312', 'volume_size': 1} May 02 10:43:15.580689 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] creating volume 'volume-0ac9460f-f823-4a1c-92b0-7d330c026312' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:43:15.581483 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:16.641795 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:43:16.642457 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:43:16.646158 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8573782c-1d46-4848-987d-20a606956a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac9460f-f823-4a1c-92b0-7d330c026312', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:43:16.650778 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55680c1-6499-4094-b06e-dc557ee3b7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:43:16.740463 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Volume volume-0ac9460f-f823-4a1c-92b0-7d330c026312 (0ac9460f-f823-4a1c-92b0-7d330c026312): created successfully May 02 10:43:16.744150 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55680c1-6499-4094-b06e-dc557ee3b7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:43:16.751055 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Flow 'volume_create_manager' (778bc461-8714-429b-830a-e7e23e850513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:43:16.813227 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-309a373d-e123-469c-b8df-3aa5cd20f433 tempest-GroupsTest-1271137687 None] Created volume successfully. May 02 10:43:17.588016 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-26353dc9-297e-4f4c-93e4-d5a2aa3ab538 tempest-GroupsTest-1271137687 None] Update group completed successfully. May 02 10:43:18.956063 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-262c876a-532a-45fc-b3b1-b3400f798be6 tempest-GroupsTest-1271137687 None] Update group completed successfully. May 02 10:43:20.362256 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:20.624263 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:43:20.624773 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] Volume volume-0ac9460f-f823-4a1c-92b0-7d330c026312 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:43:20.879524 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] deleting rbd volume volume-0ac9460f-f823-4a1c-92b0-7d330c026312 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:43:22.101646 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-005f87a5-d46e-41c3-9bda-044cf1dfd803 tempest-TaggedBootDevicesTest-94249343 None] Created reservations ['38671651-7ce8-48e5-bdf3-50279a5b7042', '5a3dd0cf-86fd-4605-8045-50d9811d1c15', '71885c1c-12f5-4cba-bd64-fd6dd29e9dfd', '533ecb43-bf28-446a-9f24-e4d56a493d6b'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:43:22.267580 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-005f87a5-d46e-41c3-9bda-044cf1dfd803 tempest-TaggedBootDevicesTest-94249343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:22.295831 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-005f87a5-d46e-41c3-9bda-044cf1dfd803 tempest-TaggedBootDevicesTest-94249343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:22.322154 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-005f87a5-d46e-41c3-9bda-044cf1dfd803 tempest-TaggedBootDevicesTest-94249343 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:43:22.326865 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-005f87a5-d46e-41c3-9bda-044cf1dfd803 tempest-TaggedBootDevicesTest-94249343 None] Deleted volume successfully. May 02 10:43:22.402831 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-005f87a5-d46e-41c3-9bda-044cf1dfd803 tempest-TaggedBootDevicesTest-94249343 None] Lock "b'cinder-6f534bd2-f64f-401c-9854-a30e90688a18-delete_volume'" released by "delete_volume" :: held 8.935s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:43:23.270835 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-5a9a74fc-1bd4-492a-8bd8-4779831892e9 tempest-TaggedBootDevicesTest-94249343 None] Lock "b'cinder-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:43:23.390228 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5a9a74fc-1bd4-492a-8bd8-4779831892e9 tempest-TaggedBootDevicesTest-94249343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:23.812841 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5a9a74fc-1bd4-492a-8bd8-4779831892e9 tempest-TaggedBootDevicesTest-94249343 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:43:24.148816 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5a9a74fc-1bd4-492a-8bd8-4779831892e9 tempest-TaggedBootDevicesTest-94249343 None] deleting rbd volume volume-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:43:28.199541 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:28.415859 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:43:28.420972 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] Volume volume-d3059e64-de85-4d44-855c-4592b7bf1b36 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:43:28.628140 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] deleting rbd volume volume-d3059e64-de85-4d44-855c-4592b7bf1b36 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:43:32.944380 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5a9a74fc-1bd4-492a-8bd8-4779831892e9 tempest-TaggedBootDevicesTest-94249343 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:43:33.428918 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5a9a74fc-1bd4-492a-8bd8-4779831892e9 tempest-TaggedBootDevicesTest-94249343 None] deleting parent snapshot volume-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:43:38.319886 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-5a9a74fc-1bd4-492a-8bd8-4779831892e9 tempest-TaggedBootDevicesTest-94249343 None] Created reservations ['73e9f28e-246d-43bb-8de0-b17d8c340648', 'f121df8a-0ce3-4fca-828a-df3aa0d8674a', '884eb9c1-8efc-4844-91cb-5b696cb68bcc', '23131dfd-9608-4963-9c08-105459425a83'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:43:38.437219 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] Created reservations ['e2e79abd-5e5e-4cf9-aed0-68700afbd264'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:43:38.461829 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-521844342 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-521844342, it is now deprecated. Please use the default quota class for default quota. May 02 10:43:38.462622 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-521844342 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-521844342, it is now deprecated. Please use the default quota class for default quota. May 02 10:43:38.525207 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5a9a74fc-1bd4-492a-8bd8-4779831892e9 tempest-TaggedBootDevicesTest-94249343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:38.565431 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5a9a74fc-1bd4-492a-8bd8-4779831892e9 tempest-TaggedBootDevicesTest-94249343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:38.600864 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-5a9a74fc-1bd4-492a-8bd8-4779831892e9 tempest-TaggedBootDevicesTest-94249343 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:43:38.606709 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5a9a74fc-1bd4-492a-8bd8-4779831892e9 tempest-TaggedBootDevicesTest-94249343 None] Deleted volume successfully. May 02 10:43:38.665802 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-5a9a74fc-1bd4-492a-8bd8-4779831892e9 tempest-TaggedBootDevicesTest-94249343 None] Lock "b'cinder-6a2e79b8-5c61-4b3f-a34e-8f7091a3dfdc-delete_volume'" released by "delete_volume" :: held 15.395s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:43:38.686657 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] Created reservations ['9f204591-b4be-4da7-87c0-370b27acae3e', '253b4ca2-5ac6-4161-8cdb-68c6ebfe05fc', 'be76eca3-ad39-48e6-8d7e-bf238eed9abc', 'e0913f0b-0c9a-42f2-aa64-eb4fac243ffe'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:43:38.926660 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] Created reservations ['ac6de278-e6bc-4e0f-9178-ca5529f0a607', '4b6b9935-86af-4c74-8b34-7be7a43efc8a', 'fb974b3f-c284-4ff4-bfd6-2df090e14c84', '95dc8e19-21fe-4360-b88a-4d151e273248'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:43:39.323685 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:39.354952 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:39.408444 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:43:39.413597 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-345f26a6-38af-4269-93d2-a587e802a265 tempest-GroupsTest-1271137687 None] Delete group completed successfully. May 02 10:43:47.591996 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2cffbe72-07e7-4db1-a3b9-f2e966cd127a tempest-GroupsV320Test-865423055 None] Group tempest-GroupsV320Test-Group-399476089: creating May 02 10:43:47.702890 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2cffbe72-07e7-4db1-a3b9-f2e966cd127a tempest-GroupsV320Test-865423055 None] Group tempest-GroupsV320Test-Group-399476089: created successfully May 02 10:43:47.714037 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2cffbe72-07e7-4db1-a3b9-f2e966cd127a tempest-GroupsV320Test-865423055 None] Create group completed successfully. May 02 10:43:48.663340 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-bba53479-21a5-4b99-a1c9-901ff3161bef req-10ac62eb-369f-4c68-bd8a-0aad9bf96bbc tempest-TaggedBootDevicesTest_v242-1280307570 None] Terminate volume connection completed successfully. May 02 10:43:48.676744 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-bba53479-21a5-4b99-a1c9-901ff3161bef req-10ac62eb-369f-4c68-bd8a-0aad9bf96bbc tempest-TaggedBootDevicesTest_v242-1280307570 None] Deleting attachment 425c2178-ae0d-426e-9899-b5005e4f0e00. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:43:48.968900 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-bba53479-21a5-4b99-a1c9-901ff3161bef req-b4493d65-824b-4af3-b360-155a129d1e5a tempest-TaggedBootDevicesTest_v242-1280307570 None] Terminate volume connection completed successfully. May 02 10:43:48.977680 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-bba53479-21a5-4b99-a1c9-901ff3161bef req-b4493d65-824b-4af3-b360-155a129d1e5a tempest-TaggedBootDevicesTest_v242-1280307570 None] Deleting attachment 4cd4b8cf-999f-45f8-a3e9-7e75b0465d8e. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:43:49.190891 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-bba53479-21a5-4b99-a1c9-901ff3161bef req-2669f27c-74ca-4a7a-b1f2-32373f3b9461 tempest-TaggedBootDevicesTest_v242-1280307570 None] Terminate volume connection completed successfully. May 02 10:43:49.191668 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-bba53479-21a5-4b99-a1c9-901ff3161bef req-2669f27c-74ca-4a7a-b1f2-32373f3b9461 tempest-TaggedBootDevicesTest_v242-1280307570 None] Deleting attachment 0c63e67b-ffe2-40ca-9c8a-fb8d28f0fe9c. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:43:49.794780 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-b076e387-3565-44e2-91f7-ff49a89251c6 tempest-GroupsV320Test-865423055 None] Created reservations ['adbaff4a-1bf6-49e8-aee3-45fb7e867cc6'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:43:49.979534 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b076e387-3565-44e2-91f7-ff49a89251c6 tempest-GroupsV320Test-865423055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:50.029610 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b076e387-3565-44e2-91f7-ff49a89251c6 tempest-GroupsV320Test-865423055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:50.098797 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-b076e387-3565-44e2-91f7-ff49a89251c6 tempest-GroupsV320Test-865423055 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:43:50.111178 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b076e387-3565-44e2-91f7-ff49a89251c6 tempest-GroupsV320Test-865423055 None] Delete group completed successfully. May 02 10:43:58.764591 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:43:58.766265 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:58.830334 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:58.893190 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:43:59.289733 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-4e18ec8c-911a-482e-bf95-d967b10556e9 tempest-TaggedBootDevicesTest_v242-1280307570 None] Lock "b'cinder-487805c3-0b5f-4d4a-afbf-61da882ab5ad-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:43:59.396177 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4e18ec8c-911a-482e-bf95-d967b10556e9 tempest-TaggedBootDevicesTest_v242-1280307570 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:43:59.588867 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4e18ec8c-911a-482e-bf95-d967b10556e9 tempest-TaggedBootDevicesTest_v242-1280307570 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:43:59.589298 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4e18ec8c-911a-482e-bf95-d967b10556e9 tempest-TaggedBootDevicesTest_v242-1280307570 None] Volume volume-487805c3-0b5f-4d4a-afbf-61da882ab5ad is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:43:59.769734 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4e18ec8c-911a-482e-bf95-d967b10556e9 tempest-TaggedBootDevicesTest_v242-1280307570 None] deleting rbd volume volume-487805c3-0b5f-4d4a-afbf-61da882ab5ad {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:44:04.063338 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-4e18ec8c-911a-482e-bf95-d967b10556e9 tempest-TaggedBootDevicesTest_v242-1280307570 None] Created reservations ['fc5b04c9-e853-4d96-b2b6-288a37722e9b', '99da47c6-f9cf-42c5-bff1-38de543f78bc', 'b85bc1b7-48cb-4f0e-a7b8-1629da2c6676', '90792804-8154-4db4-8562-8fbdf7d6fbce'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:44:04.342575 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4e18ec8c-911a-482e-bf95-d967b10556e9 tempest-TaggedBootDevicesTest_v242-1280307570 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:04.393908 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4e18ec8c-911a-482e-bf95-d967b10556e9 tempest-TaggedBootDevicesTest_v242-1280307570 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:04.436611 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-4e18ec8c-911a-482e-bf95-d967b10556e9 tempest-TaggedBootDevicesTest_v242-1280307570 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:44:04.440972 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4e18ec8c-911a-482e-bf95-d967b10556e9 tempest-TaggedBootDevicesTest_v242-1280307570 None] Deleted volume successfully. May 02 10:44:04.552810 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-4e18ec8c-911a-482e-bf95-d967b10556e9 tempest-TaggedBootDevicesTest_v242-1280307570 None] Lock "b'cinder-487805c3-0b5f-4d4a-afbf-61da882ab5ad-delete_volume'" released by "delete_volume" :: held 5.258s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:44:04.935673 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-376ec590-cd65-44fc-aa3c-8161726c5dbb tempest-TaggedBootDevicesTest_v242-1280307570 None] Lock "b'cinder-47a71972-8474-4868-a922-f7325b7b0812-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:44:05.047053 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-376ec590-cd65-44fc-aa3c-8161726c5dbb tempest-TaggedBootDevicesTest_v242-1280307570 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:05.308276 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-376ec590-cd65-44fc-aa3c-8161726c5dbb tempest-TaggedBootDevicesTest_v242-1280307570 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:44:05.308957 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-376ec590-cd65-44fc-aa3c-8161726c5dbb tempest-TaggedBootDevicesTest_v242-1280307570 None] Volume volume-47a71972-8474-4868-a922-f7325b7b0812 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:44:05.449452 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-376ec590-cd65-44fc-aa3c-8161726c5dbb tempest-TaggedBootDevicesTest_v242-1280307570 None] deleting rbd volume volume-47a71972-8474-4868-a922-f7325b7b0812 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:44:09.510453 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-376ec590-cd65-44fc-aa3c-8161726c5dbb tempest-TaggedBootDevicesTest_v242-1280307570 None] Created reservations ['2af7952e-5ae5-4845-9fa2-8937f2a06d0f', 'e10de6bc-724a-4a1a-b99c-933f8f35a25b', '19a4e89f-7388-461d-9dce-6c46b70c0b38', 'e2941b36-7b34-4908-a4e4-66293c55e129'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:44:09.753240 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-376ec590-cd65-44fc-aa3c-8161726c5dbb tempest-TaggedBootDevicesTest_v242-1280307570 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:09.809248 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-376ec590-cd65-44fc-aa3c-8161726c5dbb tempest-TaggedBootDevicesTest_v242-1280307570 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:09.888047 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-376ec590-cd65-44fc-aa3c-8161726c5dbb tempest-TaggedBootDevicesTest_v242-1280307570 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:44:09.893291 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-376ec590-cd65-44fc-aa3c-8161726c5dbb tempest-TaggedBootDevicesTest_v242-1280307570 None] Deleted volume successfully. May 02 10:44:09.982519 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-376ec590-cd65-44fc-aa3c-8161726c5dbb tempest-TaggedBootDevicesTest_v242-1280307570 None] Lock "b'cinder-47a71972-8474-4868-a922-f7325b7b0812-delete_volume'" released by "delete_volume" :: held 5.047s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:44:10.487771 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-baeaced8-245f-488f-b141-9e2a73c1a590 tempest-TaggedBootDevicesTest_v242-1280307570 None] Lock "b'cinder-8e013764-a0cb-41a8-8f5e-dde7380aee64-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:44:10.624284 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-baeaced8-245f-488f-b141-9e2a73c1a590 tempest-TaggedBootDevicesTest_v242-1280307570 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:10.794396 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-baeaced8-245f-488f-b141-9e2a73c1a590 tempest-TaggedBootDevicesTest_v242-1280307570 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:44:10.940804 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-baeaced8-245f-488f-b141-9e2a73c1a590 tempest-TaggedBootDevicesTest_v242-1280307570 None] deleting rbd volume volume-8e013764-a0cb-41a8-8f5e-dde7380aee64 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:44:15.802165 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-baeaced8-245f-488f-b141-9e2a73c1a590 tempest-TaggedBootDevicesTest_v242-1280307570 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:44:15.991300 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-baeaced8-245f-488f-b141-9e2a73c1a590 tempest-TaggedBootDevicesTest_v242-1280307570 None] deleting parent snapshot volume-8e013764-a0cb-41a8-8f5e-dde7380aee64.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:44:18.266621 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-baeaced8-245f-488f-b141-9e2a73c1a590 tempest-TaggedBootDevicesTest_v242-1280307570 None] Created reservations ['20e1c5ce-bc77-4b8e-b645-9d66d3fe06f3', '7d44374d-84ea-4d69-9edf-02495d21ae42', '72416a51-8737-4fdf-a269-183a2907aad0', '512027ba-c53a-447c-8764-46f4f061e26d'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:44:18.472655 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-baeaced8-245f-488f-b141-9e2a73c1a590 tempest-TaggedBootDevicesTest_v242-1280307570 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:18.520773 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-baeaced8-245f-488f-b141-9e2a73c1a590 tempest-TaggedBootDevicesTest_v242-1280307570 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:18.551279 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-baeaced8-245f-488f-b141-9e2a73c1a590 tempest-TaggedBootDevicesTest_v242-1280307570 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:44:18.557291 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-baeaced8-245f-488f-b141-9e2a73c1a590 tempest-TaggedBootDevicesTest_v242-1280307570 None] Deleted volume successfully. May 02 10:44:18.639048 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-baeaced8-245f-488f-b141-9e2a73c1a590 tempest-TaggedBootDevicesTest_v242-1280307570 None] Lock "b'cinder-8e013764-a0cb-41a8-8f5e-dde7380aee64-delete_volume'" released by "delete_volume" :: held 8.151s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:44:27.798553 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:44:27.834123 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Flow 'volume_create_manager' (99ced0b2-9e6e-4183-8659-7f622c9b76b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:44:27.840860 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8c81b6-595d-4401-a5cc-ca71c6b04594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:27.882483 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8c81b6-595d-4401-a5cc-ca71c6b04594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1070260153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=523ee101-7cf3-45ba-bf90-47b90f6075ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c0683d241045e5bbd52bc4f8fe82d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:44:28Z,use_quota=True,user_id='94ca71f1e7f3431fa99e7f964e183c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:27.888035 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af5e75f-4e87-448e-999f-ea7e49585217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:27.892299 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af5e75f-4e87-448e-999f-ea7e49585217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:27.898483 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bbc7ee-9098-43ba-bb4d-4f2830713366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:27.902629 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bbc7ee-9098-43ba-bb4d-4f2830713366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '523ee101-7cf3-45ba-bf90-47b90f6075ef', 'volume_name': 'volume-523ee101-7cf3-45ba-bf90-47b90f6075ef', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:27.911260 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b02fdf-740f-4548-a0d5-9eb415a56132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:27.912373 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b02fdf-740f-4548-a0d5-9eb415a56132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:27.917298 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849bff38-f797-4c8b-a872-627d3831c91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:27.918381 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Volume 523ee101-7cf3-45ba-bf90-47b90f6075ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-523ee101-7cf3-45ba-bf90-47b90f6075ef', 'volume_size': 1} May 02 10:44:27.918787 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] creating volume 'volume-523ee101-7cf3-45ba-bf90-47b90f6075ef' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:44:27.919587 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:28.636047 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:44:28.637073 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:44:28.641842 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849bff38-f797-4c8b-a872-627d3831c91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-523ee101-7cf3-45ba-bf90-47b90f6075ef', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:28.662938 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05acbc2-474c-49ae-8481-e4fa6df359cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:28.763400 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Volume volume-523ee101-7cf3-45ba-bf90-47b90f6075ef (523ee101-7cf3-45ba-bf90-47b90f6075ef): created successfully May 02 10:44:28.770190 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05acbc2-474c-49ae-8481-e4fa6df359cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:28.777176 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Flow 'volume_create_manager' (99ced0b2-9e6e-4183-8659-7f622c9b76b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:44:28.855687 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5ee485c0-492e-4273-b107-0d13f6084034 tempest-VolumesActionsTest-1197515948 None] Created volume successfully. May 02 10:44:29.737894 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-c416d55c-7596-4418-b782-1ce8e46ee500 tempest-VolumesActionsTest-1197515948 None] Lock "b'cinder-523ee101-7cf3-45ba-bf90-47b90f6075ef'" acquired by "attach_volume" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:44:30.005548 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-c416d55c-7596-4418-b782-1ce8e46ee500 tempest-VolumesActionsTest-1197515948 None] Attaching volume 523ee101-7cf3-45ba-bf90-47b90f6075ef to instance ec20d712-b9d9-4480-8e2e-e29db2dbcb9e at mountpoint /dev/sdb on host None. May 02 10:44:30.180864 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-c416d55c-7596-4418-b782-1ce8e46ee500 tempest-VolumesActionsTest-1197515948 None] Attach volume completed successfully. May 02 10:44:30.192804 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-c416d55c-7596-4418-b782-1ce8e46ee500 tempest-VolumesActionsTest-1197515948 None] Lock "b'cinder-523ee101-7cf3-45ba-bf90-47b90f6075ef'" released by "attach_volume" :: held 0.455s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:44:31.217212 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-03da502e-0669-4047-ac39-f064d078cdf0 tempest-VolumesActionsTest-2048292765 None] Terminate volume connection completed successfully. May 02 10:44:31.299185 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-03da502e-0669-4047-ac39-f064d078cdf0 tempest-VolumesActionsTest-2048292765 None] Lock "b'cinder-523ee101-7cf3-45ba-bf90-47b90f6075ef-detach_volume'" acquired by "detach_volume" :: waited 0.020s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:44:31.335189 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-03da502e-0669-4047-ac39-f064d078cdf0 tempest-VolumesActionsTest-2048292765 None] Detaching volume 523ee101-7cf3-45ba-bf90-47b90f6075ef from instance ec20d712-b9d9-4480-8e2e-e29db2dbcb9e. May 02 10:44:31.597112 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-03da502e-0669-4047-ac39-f064d078cdf0 tempest-VolumesActionsTest-2048292765 None] Detach volume completed successfully. May 02 10:44:31.603853 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-03da502e-0669-4047-ac39-f064d078cdf0 tempest-VolumesActionsTest-2048292765 None] Lock "b'cinder-523ee101-7cf3-45ba-bf90-47b90f6075ef-detach_volume'" released by "detach_volume" :: held 0.305s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:44:31.853051 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-9be5f437-53b8-410e-a86d-05a0296792f2 tempest-VolumesActionsTest-1197515948 None] Lock "b'cinder-523ee101-7cf3-45ba-bf90-47b90f6075ef-detach_volume'" acquired by "detach_volume" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:44:31.853422 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-9be5f437-53b8-410e-a86d-05a0296792f2 tempest-VolumesActionsTest-1197515948 None] Volume detach called, but volume not attached. May 02 10:44:31.975603 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-9be5f437-53b8-410e-a86d-05a0296792f2 tempest-VolumesActionsTest-1197515948 None] Lock "b'cinder-523ee101-7cf3-45ba-bf90-47b90f6075ef-detach_volume'" released by "detach_volume" :: held 0.123s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:44:39.231074 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:44:39.270588 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Flow 'volume_create_manager' (d94a56d3-00b2-49ba-90b7-b887a0b78c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:44:39.286844 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d1bce0-ba3b-4ece-8aad-d80caab6eb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:39.308062 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d1bce0-ba3b-4ece-8aad-d80caab6eb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-213215020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b3970291-af58-432b-8dde-403dc7462327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c0683d241045e5bbd52bc4f8fe82d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:44:39Z,use_quota=True,user_id='94ca71f1e7f3431fa99e7f964e183c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:39.319773 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be833d7-a088-47a8-9d8e-5e230fa768c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:39.324894 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be833d7-a088-47a8-9d8e-5e230fa768c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:39.336809 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e913e321-85d1-443a-b13e-ea704aadded9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:39.342034 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e913e321-85d1-443a-b13e-ea704aadded9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3970291-af58-432b-8dde-403dc7462327', 'volume_name': 'volume-b3970291-af58-432b-8dde-403dc7462327', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:39.349772 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbfdc1ac-7a56-4bcf-85b3-5d1c8a2c66d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:39.354507 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbfdc1ac-7a56-4bcf-85b3-5d1c8a2c66d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:39.359831 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae72e16c-3ace-4497-948d-b26ca1858112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:39.361711 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Volume b3970291-af58-432b-8dde-403dc7462327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3970291-af58-432b-8dde-403dc7462327', 'volume_size': 1} May 02 10:44:39.362321 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] creating volume 'volume-b3970291-af58-432b-8dde-403dc7462327' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:44:39.363810 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:40.201840 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:44:40.207645 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:44:40.216706 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae72e16c-3ace-4497-948d-b26ca1858112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3970291-af58-432b-8dde-403dc7462327', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:40.232888 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b498daff-77ce-4eae-b66b-ce48485b1166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:40.345970 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Volume volume-b3970291-af58-432b-8dde-403dc7462327 (b3970291-af58-432b-8dde-403dc7462327): created successfully May 02 10:44:40.355347 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b498daff-77ce-4eae-b66b-ce48485b1166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:40.363911 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Flow 'volume_create_manager' (d94a56d3-00b2-49ba-90b7-b887a0b78c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:44:40.465549 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-58b1cef0-2793-45fe-b79f-b44c622978c3 tempest-VolumesActionsTest-1197515948 None] Created volume successfully. May 02 10:44:41.354531 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-b6ed7fdc-23e0-4055-a0d7-ba998a746ba2 tempest-VolumesActionsTest-2048292765 None] Lock "b'cinder-b3970291-af58-432b-8dde-403dc7462327-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:44:41.453328 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b6ed7fdc-23e0-4055-a0d7-ba998a746ba2 tempest-VolumesActionsTest-2048292765 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:41.627455 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b6ed7fdc-23e0-4055-a0d7-ba998a746ba2 tempest-VolumesActionsTest-2048292765 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:44:41.628298 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b6ed7fdc-23e0-4055-a0d7-ba998a746ba2 tempest-VolumesActionsTest-2048292765 None] Volume volume-b3970291-af58-432b-8dde-403dc7462327 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:44:41.767518 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b6ed7fdc-23e0-4055-a0d7-ba998a746ba2 tempest-VolumesActionsTest-2048292765 None] deleting rbd volume volume-b3970291-af58-432b-8dde-403dc7462327 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:44:45.919217 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-b6ed7fdc-23e0-4055-a0d7-ba998a746ba2 tempest-VolumesActionsTest-2048292765 None] Created reservations ['14e23d32-1aea-4ea0-845f-d2bf856d09f7', 'f107efa7-4ca4-4c8e-b7e4-85e8c81dbfcf', '09374824-55d4-4895-aedb-d8cbfc48db1b', '1468013d-9c88-49d0-8267-7a3108859ee2'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:44:46.123249 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b6ed7fdc-23e0-4055-a0d7-ba998a746ba2 tempest-VolumesActionsTest-2048292765 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:46.162140 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b6ed7fdc-23e0-4055-a0d7-ba998a746ba2 tempest-VolumesActionsTest-2048292765 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:46.187701 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-b6ed7fdc-23e0-4055-a0d7-ba998a746ba2 tempest-VolumesActionsTest-2048292765 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:44:46.200479 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b6ed7fdc-23e0-4055-a0d7-ba998a746ba2 tempest-VolumesActionsTest-2048292765 None] Deleted volume successfully. May 02 10:44:46.303817 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-b6ed7fdc-23e0-4055-a0d7-ba998a746ba2 tempest-VolumesActionsTest-2048292765 None] Lock "b'cinder-b3970291-af58-432b-8dde-403dc7462327-delete_volume'" released by "delete_volume" :: held 4.960s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:44:47.638747 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:44:47.659361 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Flow 'volume_create_manager' (761477e0-07cc-4bfb-8a38-7c31a6346cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:44:47.666154 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a7f556-da79-46fc-b730-45a3e675e6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:47.686125 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a7f556-da79-46fc-b730-45a3e675e6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-120273028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c29a140c-018b-4931-a869-8c668c0003d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c0683d241045e5bbd52bc4f8fe82d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:44:47Z,use_quota=True,user_id='94ca71f1e7f3431fa99e7f964e183c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:47.738515 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5b9688-6f40-4b00-839e-50886149268f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:47.738515 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5b9688-6f40-4b00-839e-50886149268f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:47.738515 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a6c6dd-5c26-486f-824c-2d29be966999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:47.739330 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a6c6dd-5c26-486f-824c-2d29be966999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29a140c-018b-4931-a869-8c668c0003d7', 'volume_name': 'volume-c29a140c-018b-4931-a869-8c668c0003d7', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:47.739330 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce0db01-3b9b-41c9-89d4-67a48423f8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:47.739330 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce0db01-3b9b-41c9-89d4-67a48423f8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:47.739584 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00100f8-d89c-44d3-a3e2-d97b9c36696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:47.739584 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Volume c29a140c-018b-4931-a869-8c668c0003d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29a140c-018b-4931-a869-8c668c0003d7', 'volume_size': 1} May 02 10:44:47.739584 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] creating volume 'volume-c29a140c-018b-4931-a869-8c668c0003d7' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:44:47.739584 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:48.814539 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:44:48.815263 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:44:48.820210 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00100f8-d89c-44d3-a3e2-d97b9c36696f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29a140c-018b-4931-a869-8c668c0003d7', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:48.826012 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd817a59-f5a8-4a74-9be6-644550e90a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:48.913587 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Volume volume-c29a140c-018b-4931-a869-8c668c0003d7 (c29a140c-018b-4931-a869-8c668c0003d7): created successfully May 02 10:44:48.921205 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd817a59-f5a8-4a74-9be6-644550e90a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:48.931653 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Flow 'volume_create_manager' (761477e0-07cc-4bfb-8a38-7c31a6346cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:44:49.028008 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-40ee5792-8cae-4c02-b568-3e134a14888e tempest-VolumesActionsTest-1197515948 None] Created volume successfully. May 02 10:44:50.050946 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-6a0f01ed-05fa-4fd8-a7e9-6af37786beb7 tempest-VolumesActionsTest-2048292765 None] Lock "b'cinder-c29a140c-018b-4931-a869-8c668c0003d7-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:44:50.156134 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6a0f01ed-05fa-4fd8-a7e9-6af37786beb7 tempest-VolumesActionsTest-2048292765 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:50.328581 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6a0f01ed-05fa-4fd8-a7e9-6af37786beb7 tempest-VolumesActionsTest-2048292765 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:44:50.332831 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6a0f01ed-05fa-4fd8-a7e9-6af37786beb7 tempest-VolumesActionsTest-2048292765 None] Volume volume-c29a140c-018b-4931-a869-8c668c0003d7 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:44:50.468061 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6a0f01ed-05fa-4fd8-a7e9-6af37786beb7 tempest-VolumesActionsTest-2048292765 None] deleting rbd volume volume-c29a140c-018b-4931-a869-8c668c0003d7 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:44:54.071174 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-6a0f01ed-05fa-4fd8-a7e9-6af37786beb7 tempest-VolumesActionsTest-2048292765 None] Created reservations ['1428fbc0-54ed-4bd9-bdeb-025c40a4e1b7', 'ce4d5a95-9f3c-4207-9f40-d2bf2f8e2595', '723106e4-af98-44e6-9b04-8e53b8df64e2', '05dd4cb8-0285-45d9-b44d-a09c19a170b6'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:44:54.289265 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6a0f01ed-05fa-4fd8-a7e9-6af37786beb7 tempest-VolumesActionsTest-2048292765 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:54.326074 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6a0f01ed-05fa-4fd8-a7e9-6af37786beb7 tempest-VolumesActionsTest-2048292765 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:54.393491 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-6a0f01ed-05fa-4fd8-a7e9-6af37786beb7 tempest-VolumesActionsTest-2048292765 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:44:54.411720 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-6a0f01ed-05fa-4fd8-a7e9-6af37786beb7 tempest-VolumesActionsTest-2048292765 None] Deleted volume successfully. May 02 10:44:54.514596 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-6a0f01ed-05fa-4fd8-a7e9-6af37786beb7 tempest-VolumesActionsTest-2048292765 None] Lock "b'cinder-c29a140c-018b-4931-a869-8c668c0003d7-delete_volume'" released by "delete_volume" :: held 4.464s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:44:55.318063 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:44:55.338680 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Flow 'volume_create_manager' (d8543536-51c2-4b03-8a53-0fc5d07c413a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:44:55.345531 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2117fe6-56de-49ed-b40e-70b9033bbde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:55.361786 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2117fe6-56de-49ed-b40e-70b9033bbde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360563668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c0683d241045e5bbd52bc4f8fe82d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:44:55Z,use_quota=True,user_id='94ca71f1e7f3431fa99e7f964e183c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:55.367328 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6712a741-f29a-46e4-8e86-ca84963cb930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:55.371555 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6712a741-f29a-46e4-8e86-ca84963cb930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:55.377058 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e0d4f2-ad20-434f-9331-979c1fb06c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:55.381761 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e0d4f2-ad20-434f-9331-979c1fb06c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5', 'volume_name': 'volume-7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:55.386863 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e922140-308d-4370-8698-0b0b4d5b21ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:55.390794 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e922140-308d-4370-8698-0b0b4d5b21ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:55.396156 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f5404c-764f-4fe4-94ac-a25906d40561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:55.397301 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Volume 7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5', 'volume_size': 1} May 02 10:44:55.397700 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] creating volume 'volume-7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:44:55.398577 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:56.004359 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:44:56.004359 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:44:56.007888 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f5404c-764f-4fe4-94ac-a25906d40561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:56.013034 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871bc70f-5690-455b-8d69-22018c61d294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:44:56.099824 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Volume volume-7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5 (7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5): created successfully May 02 10:44:56.105196 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871bc70f-5690-455b-8d69-22018c61d294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:44:56.112485 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Flow 'volume_create_manager' (d8543536-51c2-4b03-8a53-0fc5d07c413a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:44:56.185162 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-6b7a86c1-1a67-41e0-bbb5-36a403246039 tempest-VolumesActionsTest-1197515948 None] Created volume successfully. May 02 10:44:57.774531 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-cef28678-f2e9-4e8e-a117-02702530fb7d tempest-VolumesActionsTest-2048292765 None] Lock "b'cinder-7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:44:57.877384 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cef28678-f2e9-4e8e-a117-02702530fb7d tempest-VolumesActionsTest-2048292765 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:58.033354 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cef28678-f2e9-4e8e-a117-02702530fb7d tempest-VolumesActionsTest-2048292765 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:44:58.034283 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cef28678-f2e9-4e8e-a117-02702530fb7d tempest-VolumesActionsTest-2048292765 None] Volume volume-7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:44:58.153662 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cef28678-f2e9-4e8e-a117-02702530fb7d tempest-VolumesActionsTest-2048292765 None] deleting rbd volume volume-7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:44:58.766991 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:44:58.767781 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:58.794790 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:44:58.826751 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:45:01.678715 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-cef28678-f2e9-4e8e-a117-02702530fb7d tempest-VolumesActionsTest-2048292765 None] Created reservations ['2a844c56-7ae2-4bdf-9eea-129ca4170cfd', '9463f26a-03e2-4829-b000-0508c941cda9', '119bdac4-2855-4a39-af32-0d7a891043b0', '6a5b3286-b341-4268-b937-fab4c048b6d2'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:45:01.891792 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cef28678-f2e9-4e8e-a117-02702530fb7d tempest-VolumesActionsTest-2048292765 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:01.970656 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cef28678-f2e9-4e8e-a117-02702530fb7d tempest-VolumesActionsTest-2048292765 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:02.029266 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-cef28678-f2e9-4e8e-a117-02702530fb7d tempest-VolumesActionsTest-2048292765 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:45:02.038538 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-cef28678-f2e9-4e8e-a117-02702530fb7d tempest-VolumesActionsTest-2048292765 None] Deleted volume successfully. May 02 10:45:02.117713 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-cef28678-f2e9-4e8e-a117-02702530fb7d tempest-VolumesActionsTest-2048292765 None] Lock "b'cinder-7b1d6ba0-b8a8-43a2-b4f0-4d9d984798d5-delete_volume'" released by "delete_volume" :: held 4.343s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:45:02.954916 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:45:02.984857 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Flow 'volume_create_manager' (3ba02f5d-fb6c-49b4-aba8-929f2eba8fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:45:02.993134 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ec8dfa-e001-4f81-9fef-59354f352dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:03.017235 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ec8dfa-e001-4f81-9fef-59354f352dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-366285410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=58f8a83f-a155-4b34-99f7-3eacebb15a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c0683d241045e5bbd52bc4f8fe82d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:45:03Z,use_quota=True,user_id='94ca71f1e7f3431fa99e7f964e183c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:03.022815 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bacdaa-9a30-44d1-b88c-ba9b6ecd674b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:03.027068 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bacdaa-9a30-44d1-b88c-ba9b6ecd674b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:03.032562 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443aa70a-dd54-4a9f-87ed-eb312411253d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:03.038006 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443aa70a-dd54-4a9f-87ed-eb312411253d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f8a83f-a155-4b34-99f7-3eacebb15a67', 'volume_name': 'volume-58f8a83f-a155-4b34-99f7-3eacebb15a67', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:03.043040 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c66ba5-e9bb-4a3d-a2a3-4d5c0db50b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:03.047067 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c66ba5-e9bb-4a3d-a2a3-4d5c0db50b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:03.052870 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640375d8-150b-470f-a524-c3bef89d9f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:03.054184 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Volume 58f8a83f-a155-4b34-99f7-3eacebb15a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f8a83f-a155-4b34-99f7-3eacebb15a67', 'volume_size': 1} May 02 10:45:03.054820 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] creating volume 'volume-58f8a83f-a155-4b34-99f7-3eacebb15a67' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:45:03.055829 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:03.696545 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:45:03.696973 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:45:03.705700 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640375d8-150b-470f-a524-c3bef89d9f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f8a83f-a155-4b34-99f7-3eacebb15a67', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:03.715100 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c5376c-cad5-4724-9bf2-791447a483e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:03.776169 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Volume volume-58f8a83f-a155-4b34-99f7-3eacebb15a67 (58f8a83f-a155-4b34-99f7-3eacebb15a67): created successfully May 02 10:45:03.780771 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c5376c-cad5-4724-9bf2-791447a483e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:03.787530 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Flow 'volume_create_manager' (3ba02f5d-fb6c-49b4-aba8-929f2eba8fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:45:03.988367 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-921025da-83e3-4f10-aeec-9f586b2e8cb1 tempest-VolumesActionsTest-1197515948 None] Created volume successfully. May 02 10:45:05.406616 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-d565f3ff-7fd3-43fa-8abe-1a423b1556a9 tempest-VolumesActionsTest-2048292765 None] Lock "b'cinder-58f8a83f-a155-4b34-99f7-3eacebb15a67-delete_volume'" acquired by "delete_volume" :: waited 0.037s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:45:05.554635 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d565f3ff-7fd3-43fa-8abe-1a423b1556a9 tempest-VolumesActionsTest-2048292765 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:05.716473 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d565f3ff-7fd3-43fa-8abe-1a423b1556a9 tempest-VolumesActionsTest-2048292765 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:45:05.717198 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d565f3ff-7fd3-43fa-8abe-1a423b1556a9 tempest-VolumesActionsTest-2048292765 None] Volume volume-58f8a83f-a155-4b34-99f7-3eacebb15a67 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:45:05.819852 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d565f3ff-7fd3-43fa-8abe-1a423b1556a9 tempest-VolumesActionsTest-2048292765 None] deleting rbd volume volume-58f8a83f-a155-4b34-99f7-3eacebb15a67 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:45:09.507419 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-d565f3ff-7fd3-43fa-8abe-1a423b1556a9 tempest-VolumesActionsTest-2048292765 None] Created reservations ['53ccb85c-8830-404f-96b8-f95d9f75817c', '4474414a-3fd7-44b2-9f4f-f8f6b4f7a314', '8bae9b69-f435-4416-9e12-a5f2436127cf', '16e53b01-b751-4538-8e09-6a72474fd2a7'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:45:09.714595 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d565f3ff-7fd3-43fa-8abe-1a423b1556a9 tempest-VolumesActionsTest-2048292765 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:09.751754 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d565f3ff-7fd3-43fa-8abe-1a423b1556a9 tempest-VolumesActionsTest-2048292765 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:09.781364 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-d565f3ff-7fd3-43fa-8abe-1a423b1556a9 tempest-VolumesActionsTest-2048292765 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:45:09.794928 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-d565f3ff-7fd3-43fa-8abe-1a423b1556a9 tempest-VolumesActionsTest-2048292765 None] Deleted volume successfully. May 02 10:45:09.930556 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-d565f3ff-7fd3-43fa-8abe-1a423b1556a9 tempest-VolumesActionsTest-2048292765 None] Lock "b'cinder-58f8a83f-a155-4b34-99f7-3eacebb15a67-delete_volume'" released by "delete_volume" :: held 4.520s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:45:10.771557 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:45:10.791453 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Flow 'volume_create_manager' (367be0e8-ed57-4c25-8bbc-25f6bf466d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:45:10.798176 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e431b0-a274-420b-afb6-4a1033d4e6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:10.815405 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e431b0-a274-420b-afb6-4a1033d4e6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-431843755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c0683d241045e5bbd52bc4f8fe82d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:45:11Z,use_quota=True,user_id='94ca71f1e7f3431fa99e7f964e183c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:10.821303 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3376965-a6ec-4c57-9fca-f48c6a8e03d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:10.825672 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3376965-a6ec-4c57-9fca-f48c6a8e03d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:10.831482 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96705267-41ff-45b1-ad00-69a8542af57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:10.835752 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96705267-41ff-45b1-ad00-69a8542af57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2', 'volume_name': 'volume-15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:10.841029 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4095560f-d2de-4e5b-a628-0307e6f45ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:10.845849 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4095560f-d2de-4e5b-a628-0307e6f45ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:10.850763 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f871b9be-d125-42fb-bf6d-61f18871a0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:10.851864 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Volume 15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2', 'volume_size': 1} May 02 10:45:10.852265 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] creating volume 'volume-15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:45:10.853080 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:11.465083 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:45:11.465694 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:45:11.471438 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f871b9be-d125-42fb-bf6d-61f18871a0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:11.476986 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e75e55ba-a4fb-4fa1-a562-afe3a902f456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:11.570055 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Volume volume-15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2 (15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2): created successfully May 02 10:45:11.574773 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e75e55ba-a4fb-4fa1-a562-afe3a902f456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:11.581203 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Flow 'volume_create_manager' (367be0e8-ed57-4c25-8bbc-25f6bf466d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:45:11.644367 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-89f59d6a-a7b2-4e4f-9839-fdd7fc2f1391 tempest-VolumesActionsTest-1197515948 None] Created volume successfully. May 02 10:45:13.979680 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-60e1d206-3790-41f9-a20e-26ac237c9f83 tempest-VolumesActionsTest-1197515948 None] Lock "b'cinder-15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:45:14.147073 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-60e1d206-3790-41f9-a20e-26ac237c9f83 tempest-VolumesActionsTest-1197515948 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:14.315859 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-60e1d206-3790-41f9-a20e-26ac237c9f83 tempest-VolumesActionsTest-1197515948 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:45:14.316301 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-60e1d206-3790-41f9-a20e-26ac237c9f83 tempest-VolumesActionsTest-1197515948 None] Volume volume-15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:45:14.434576 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-60e1d206-3790-41f9-a20e-26ac237c9f83 tempest-VolumesActionsTest-1197515948 None] deleting rbd volume volume-15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:45:18.307338 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-60e1d206-3790-41f9-a20e-26ac237c9f83 tempest-VolumesActionsTest-1197515948 None] Created reservations ['b23c246f-e5c7-4c95-bb8d-01c1f5ec0ba8', '6df167f1-9fc7-457d-a608-1fbbef320437', 'aac26fd2-e627-4db0-b582-2c73471b6bde', 'aec83bea-f4d5-4468-ad16-32a02afad7e7'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:45:18.585464 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-60e1d206-3790-41f9-a20e-26ac237c9f83 tempest-VolumesActionsTest-1197515948 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:18.630350 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-60e1d206-3790-41f9-a20e-26ac237c9f83 tempest-VolumesActionsTest-1197515948 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:18.681550 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-60e1d206-3790-41f9-a20e-26ac237c9f83 tempest-VolumesActionsTest-1197515948 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:45:18.694054 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-60e1d206-3790-41f9-a20e-26ac237c9f83 tempest-VolumesActionsTest-1197515948 None] Deleted volume successfully. May 02 10:45:19.047589 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-60e1d206-3790-41f9-a20e-26ac237c9f83 tempest-VolumesActionsTest-1197515948 None] Lock "b'cinder-15e31be2-2a6a-4cbe-a902-eb4b5e3cdbe2-delete_volume'" released by "delete_volume" :: held 5.068s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:45:19.597012 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a805aa9d-c459-4e57-9d15-c6c00634f84f tempest-VolumesActionsTest-1197515948 None] Lock "b'cinder-523ee101-7cf3-45ba-bf90-47b90f6075ef-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:45:19.725020 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a805aa9d-c459-4e57-9d15-c6c00634f84f tempest-VolumesActionsTest-1197515948 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:19.881491 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a805aa9d-c459-4e57-9d15-c6c00634f84f tempest-VolumesActionsTest-1197515948 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:45:19.885113 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a805aa9d-c459-4e57-9d15-c6c00634f84f tempest-VolumesActionsTest-1197515948 None] Volume volume-523ee101-7cf3-45ba-bf90-47b90f6075ef is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:45:19.981673 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a805aa9d-c459-4e57-9d15-c6c00634f84f tempest-VolumesActionsTest-1197515948 None] deleting rbd volume volume-523ee101-7cf3-45ba-bf90-47b90f6075ef {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:45:23.741468 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-a805aa9d-c459-4e57-9d15-c6c00634f84f tempest-VolumesActionsTest-1197515948 None] Created reservations ['ed95c049-1eaf-417f-b976-f62a63c2bef0', '709768ea-6174-4d72-9312-b5731cdd8318', 'ec5823e7-2fa1-4ffb-b201-6adcb3ba82e1', '78eab9b5-28b1-4488-a76a-499d8521d05a'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:45:23.931609 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a805aa9d-c459-4e57-9d15-c6c00634f84f tempest-VolumesActionsTest-1197515948 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:23.999864 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a805aa9d-c459-4e57-9d15-c6c00634f84f tempest-VolumesActionsTest-1197515948 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:24.061243 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-a805aa9d-c459-4e57-9d15-c6c00634f84f tempest-VolumesActionsTest-1197515948 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:45:24.066637 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a805aa9d-c459-4e57-9d15-c6c00634f84f tempest-VolumesActionsTest-1197515948 None] Deleted volume successfully. May 02 10:45:24.145169 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a805aa9d-c459-4e57-9d15-c6c00634f84f tempest-VolumesActionsTest-1197515948 None] Lock "b'cinder-523ee101-7cf3-45ba-bf90-47b90f6075ef-delete_volume'" released by "delete_volume" :: held 4.555s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:45:33.671809 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:45:33.703777 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Flow 'volume_create_manager' (a3c79a3c-de85-480e-914a-41f713cb8e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:45:33.712881 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6bddec-cfc3-4580-870d-5a1c404d32d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:33.730290 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6bddec-cfc3-4580-870d-5a1c404d32d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-497719296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1fed6e7-1157-4a66-af30-dddfb260dbb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561e89131f06493c86bc50726a607921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:45:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:45:34Z,use_quota=True,user_id='53f725648a464c35bd318808ac58d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:33.736117 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130edef7-ed53-43e3-adf8-1e31b096e124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:33.740337 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130edef7-ed53-43e3-adf8-1e31b096e124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:33.746199 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c459d388-3833-4310-9a42-5ed53523d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:33.750372 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c459d388-3833-4310-9a42-5ed53523d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1fed6e7-1157-4a66-af30-dddfb260dbb6', 'volume_name': 'volume-c1fed6e7-1157-4a66-af30-dddfb260dbb6', 'volume_size': 2}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:33.755870 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33782e18-a89b-47c7-b755-4cbade7572b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:33.760028 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33782e18-a89b-47c7-b755-4cbade7572b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:33.764743 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe847cf-460e-4bac-813c-1a97110ee3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:33.766010 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Volume c1fed6e7-1157-4a66-af30-dddfb260dbb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1fed6e7-1157-4a66-af30-dddfb260dbb6', 'volume_size': 2} May 02 10:45:33.767189 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] creating volume 'volume-c1fed6e7-1157-4a66-af30-dddfb260dbb6' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:45:33.768023 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:34.436660 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:45:34.437163 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:45:34.440975 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe847cf-460e-4bac-813c-1a97110ee3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fed6e7-1157-4a66-af30-dddfb260dbb6', 'volume_size': 2}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:34.446479 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d130c591-3eec-40b0-90d3-d04f097abac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:34.529573 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Volume volume-c1fed6e7-1157-4a66-af30-dddfb260dbb6 (c1fed6e7-1157-4a66-af30-dddfb260dbb6): created successfully May 02 10:45:34.533874 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d130c591-3eec-40b0-90d3-d04f097abac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:34.539693 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Flow 'volume_create_manager' (a3c79a3c-de85-480e-914a-41f713cb8e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:45:34.614916 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-039bcd85-b81c-4117-aea5-bf66f8a0a8d8 tempest-VolumesCloneNegativeTest-1892719333 None] Created volume successfully. May 02 10:45:35.860648 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-197681d7-dcf0-41a2-a71a-8e43b5d28031 tempest-VolumesCloneNegativeTest-1892719333 None] Lock "b'cinder-c1fed6e7-1157-4a66-af30-dddfb260dbb6-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:45:35.958264 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-197681d7-dcf0-41a2-a71a-8e43b5d28031 tempest-VolumesCloneNegativeTest-1892719333 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:36.191825 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-197681d7-dcf0-41a2-a71a-8e43b5d28031 tempest-VolumesCloneNegativeTest-1892719333 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:45:36.196250 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-197681d7-dcf0-41a2-a71a-8e43b5d28031 tempest-VolumesCloneNegativeTest-1892719333 None] Volume volume-c1fed6e7-1157-4a66-af30-dddfb260dbb6 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:45:36.321575 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-197681d7-dcf0-41a2-a71a-8e43b5d28031 tempest-VolumesCloneNegativeTest-1892719333 None] deleting rbd volume volume-c1fed6e7-1157-4a66-af30-dddfb260dbb6 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:45:40.101583 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-197681d7-dcf0-41a2-a71a-8e43b5d28031 tempest-VolumesCloneNegativeTest-1892719333 None] Created reservations ['8694e9b7-3d58-474a-971f-6ccc733a8fcb', '55536d28-bf05-4745-a274-7bccd6c1a69f', 'c743691f-bb8c-4d75-9255-485ff82391d1', '4593b848-39ac-4a03-933b-e881b6a99971'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:45:40.366209 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-197681d7-dcf0-41a2-a71a-8e43b5d28031 tempest-VolumesCloneNegativeTest-1892719333 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:40.427159 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-197681d7-dcf0-41a2-a71a-8e43b5d28031 tempest-VolumesCloneNegativeTest-1892719333 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:40.524698 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-197681d7-dcf0-41a2-a71a-8e43b5d28031 tempest-VolumesCloneNegativeTest-1892719333 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:45:40.554761 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-197681d7-dcf0-41a2-a71a-8e43b5d28031 tempest-VolumesCloneNegativeTest-1892719333 None] Deleted volume successfully. May 02 10:45:40.648842 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-197681d7-dcf0-41a2-a71a-8e43b5d28031 tempest-VolumesCloneNegativeTest-1892719333 None] Lock "b'cinder-c1fed6e7-1157-4a66-af30-dddfb260dbb6-delete_volume'" released by "delete_volume" :: held 4.788s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:45:49.754257 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:45:49.820666 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Flow 'volume_create_manager' (885c6d11-0997-4a97-a64d-9c95f8857a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:45:49.829760 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97505fa2-917c-4d8c-88a5-82ef9d26c911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:49.854126 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97505fa2-917c-4d8c-88a5-82ef9d26c911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-123036584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f570807a-66b8-416f-b0c4-f488a0f13513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23dc31c03ada4eba97ae47aab53487d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:45:49Z,use_quota=True,user_id='f58c631280fb4cdb917abc34660e3325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:49.862166 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f8dcb2e-8da9-422c-ab8a-3d69fcc215e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:49.868332 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f8dcb2e-8da9-422c-ab8a-3d69fcc215e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:49.874211 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a374fa22-df97-4b63-a2c3-a5c7c71d4fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:49.879767 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a374fa22-df97-4b63-a2c3-a5c7c71d4fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f570807a-66b8-416f-b0c4-f488a0f13513', 'volume_name': 'volume-f570807a-66b8-416f-b0c4-f488a0f13513', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:49.892696 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafe5b51-d9b3-4ee0-b39a-6c4a997c803b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:49.897838 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafe5b51-d9b3-4ee0-b39a-6c4a997c803b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:49.903090 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695f6300-0aaf-4501-8381-27b0a712d645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:49.905298 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Volume f570807a-66b8-416f-b0c4-f488a0f13513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f570807a-66b8-416f-b0c4-f488a0f13513', 'volume_size': 1} May 02 10:45:49.905872 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] creating volume 'volume-f570807a-66b8-416f-b0c4-f488a0f13513' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:45:49.907030 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:50.646695 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:45:50.647374 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:45:50.655156 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695f6300-0aaf-4501-8381-27b0a712d645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f570807a-66b8-416f-b0c4-f488a0f13513', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:50.666078 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f320deb9-c904-4407-8110-afb429c2d999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:45:50.767899 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Volume volume-f570807a-66b8-416f-b0c4-f488a0f13513 (f570807a-66b8-416f-b0c4-f488a0f13513): created successfully May 02 10:45:50.776330 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f320deb9-c904-4407-8110-afb429c2d999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:45:50.807222 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Flow 'volume_create_manager' (885c6d11-0997-4a97-a64d-9c95f8857a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:45:50.946367 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-23aeaf85-cbac-4620-a6dd-b5fcbdef2e99 tempest-VolumesSnapshotTestJSON-616137826 None] Created volume successfully. May 02 10:45:52.219713 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1d19b337-7d8b-4bbb-86a6-1bb31c161dc1 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:54.247483 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-1d19b337-7d8b-4bbb-86a6-1bb31c161dc1 tempest-VolumesSnapshotTestJSON-616137826 None] Create snapshot completed successfully May 02 10:45:55.985770 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.driver [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] Creating a new backup for volume volume-f570807a-66b8-416f-b0c4-f488a0f13513. {{(pid=123784) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1213}} May 02 10:45:56.110456 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] cloning volumes/volume-f570807a-66b8-416f-b0c4-f488a0f13513@snapshot-e80dbe72-5018-4eb1-abbb-192fc2c0d6df to volume-b2af681b-29a3-4460-a5c7-613eda5347ef {{(pid=123784) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 02 10:45:56.111141 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:56.267057 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:57.554771 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:45:57.555857 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:45:57.561824 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:57.630177 ncdv-master-1 cinder-volume[123784]: WARNING cinder.volume.drivers.rbd [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues May 02 10:45:57.832252 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-02T10:45:55Z,data_timestamp=2022-05-02T10:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-67453090',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=1fda047b-3fa4-47f3-9d96-75a2cc7a3402,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='23dc31c03ada4eba97ae47aab53487d9',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='e80dbe72-5018-4eb1-abbb-192fc2c0d6df',status='creating',temp_snapshot_id=None,temp_volume_id='b2af681b-29a3-4460-a5c7-613eda5347ef',updated_at=None,user_id='f58c631280fb4cdb917abc34660e3325',volume_id=f570807a-66b8-416f-b0c4-f488a0f13513) May 02 10:45:57.833348 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.backup.rpcapi [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] continue_backup in rpcapi backup_id 1fda047b-3fa4-47f3-9d96-75a2cc7a3402 {{(pid=123784) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 02 10:45:58.153526 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:45:58.772260 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:45:58.773863 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:58.865183 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:45:58.915551 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:45:59.296487 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.146s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:45:59.298789 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b2af681b-29a3-4460-a5c7-613eda5347ef', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'b2af681b-29a3-4460-a5c7-613eda5347ef', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:45:59.314212 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] Initialize volume connection completed successfully. May 02 10:46:58.772324 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:46:58.773801 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:46:58.830624 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:46:58.874921 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:47:29.259653 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] Terminate volume connection completed successfully. May 02 10:47:29.280793 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] Remove volume export completed successfully. May 02 10:47:29.329022 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-b2af681b-29a3-4460-a5c7-613eda5347ef-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:47:29.344555 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:47:29.536053 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:47:29.665929 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] deleting rbd volume volume-b2af681b-29a3-4460-a5c7-613eda5347ef {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:47:36.811770 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] Deleted volume successfully. May 02 10:47:36.819893 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-dd1e626a-c41e-4e32-a321-7c42923675e3 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-b2af681b-29a3-4460-a5c7-613eda5347ef-delete_volume'" released by "delete_volume" :: held 7.490s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:47:52.774601 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:47:52.816787 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Flow 'volume_create_manager' (f1660b71-bfa8-47bb-8de9-40fa6179ae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:47:52.840937 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82ffa1e-515b-4b77-bfa9-14e9f4c7ca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:52.905309 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82ffa1e-515b-4b77-bfa9-14e9f4c7ca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1650678649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c197dec70ede42cea499386f26da34b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:47:53Z,use_quota=True,user_id='88360efcaac7437da89004995e392caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:52.920631 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e929ce7-a216-4424-8404-1d6a89c2dc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:52.928338 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e929ce7-a216-4424-8404-1d6a89c2dc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:52.936490 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0b864a-c067-4244-ab9e-8212a74a9e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:52.943298 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0b864a-c067-4244-ab9e-8212a74a9e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2', 'volume_name': 'volume-de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:52.950328 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3926c319-a2ec-4ea0-a479-49d9134ba076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:52.955676 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3926c319-a2ec-4ea0-a479-49d9134ba076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:52.961007 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bab554-896c-4f78-9481-40cf3f7f337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:52.962455 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Volume de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2', 'volume_size': 1} May 02 10:47:52.963952 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] creating volume 'volume-de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:47:52.964964 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:47:53.464038 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:47:53.464038 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:47:53.464038 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bab554-896c-4f78-9481-40cf3f7f337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:53.465242 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4655e3cc-306a-41ca-a3e7-ab88b92524a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:53.524109 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Volume volume-de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2 (de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2): created successfully May 02 10:47:53.532243 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4655e3cc-306a-41ca-a3e7-ab88b92524a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:53.539659 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Flow 'volume_create_manager' (f1660b71-bfa8-47bb-8de9-40fa6179ae88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:47:53.624486 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-9f352706-182d-43c7-8a91-8f9650208b45 tempest-VolumesListAdminTestJSON-1013683103 None] Created volume successfully. May 02 10:47:54.699091 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:47:54.719774 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Flow 'volume_create_manager' (68a43056-fac9-42a4-917e-61ec314aede1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:47:54.726789 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3a4fce-00e1-4660-95c4-8182c49404a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:54.743487 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3a4fce-00e1-4660-95c4-8182c49404a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-466172039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f8d4166-93d4-4ab9-b28f-81cef79f7fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c197dec70ede42cea499386f26da34b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:47:55Z,use_quota=True,user_id='88360efcaac7437da89004995e392caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:54.749983 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fcf347-981d-4e14-9953-5f78814baa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:54.754616 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fcf347-981d-4e14-9953-5f78814baa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:54.762770 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce557ff-c0c4-4cd7-8d42-e90008b04d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:54.768089 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce557ff-c0c4-4cd7-8d42-e90008b04d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8d4166-93d4-4ab9-b28f-81cef79f7fa0', 'volume_name': 'volume-4f8d4166-93d4-4ab9-b28f-81cef79f7fa0', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:54.774493 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0049e7df-acfa-453f-8f11-b19aabe36cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:54.779587 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0049e7df-acfa-453f-8f11-b19aabe36cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:54.786249 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858c13b7-6da7-4408-b9fa-8ba7087e6cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:54.787994 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Volume 4f8d4166-93d4-4ab9-b28f-81cef79f7fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8d4166-93d4-4ab9-b28f-81cef79f7fa0', 'volume_size': 1} May 02 10:47:54.788890 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] creating volume 'volume-4f8d4166-93d4-4ab9-b28f-81cef79f7fa0' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:47:54.790473 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:47:55.408413 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:47:55.408640 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:47:55.417680 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858c13b7-6da7-4408-b9fa-8ba7087e6cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8d4166-93d4-4ab9-b28f-81cef79f7fa0', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:55.421177 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3f2cac-8d6e-4875-a3c2-ff2e048b27f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:55.466513 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Volume volume-4f8d4166-93d4-4ab9-b28f-81cef79f7fa0 (4f8d4166-93d4-4ab9-b28f-81cef79f7fa0): created successfully May 02 10:47:55.470256 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3f2cac-8d6e-4875-a3c2-ff2e048b27f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:55.476766 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Flow 'volume_create_manager' (68a43056-fac9-42a4-917e-61ec314aede1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:47:55.558526 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-7b8e42f4-eec8-4b40-a2cf-2656d2b1d749 tempest-VolumesListAdminTestJSON-1013683103 None] Created volume successfully. May 02 10:47:56.397197 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:47:56.429176 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Flow 'volume_create_manager' (5859cb5d-bf00-48dc-836d-2b65e8d9a8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:47:56.445413 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b152f1-2665-4dd3-b425-5fa35301c1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:56.467934 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b152f1-2665-4dd3-b425-5fa35301c1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1981105584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c197dec70ede42cea499386f26da34b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:47:56Z,use_quota=True,user_id='88360efcaac7437da89004995e392caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:56.479528 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe4d47a-2ae9-4991-8216-41cda2002291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:56.486734 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe4d47a-2ae9-4991-8216-41cda2002291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:56.493842 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8e1039-1a08-40a2-8865-f3d3438d21c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:56.498700 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8e1039-1a08-40a2-8865-f3d3438d21c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3', 'volume_name': 'volume-c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:56.505351 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6685ba-9d2b-4f01-b83d-d2cb7c920e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:56.510405 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6685ba-9d2b-4f01-b83d-d2cb7c920e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:56.516351 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663eef66-cb65-42e7-a1db-aa3afd575c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:56.521578 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Volume c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3', 'volume_size': 1} May 02 10:47:56.521578 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] creating volume 'volume-c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:47:56.521578 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:47:56.915554 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:47:56.935942 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Flow 'volume_create_manager' (86a6961c-a6d1-4d52-8796-341c321de049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:47:56.943717 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773a91c6-db19-4a45-bacd-c958a774c1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:56.975988 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773a91c6-db19-4a45-bacd-c958a774c1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1312611118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6a48dd65-564d-450c-81a0-e653ff2aaa29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a92939abc5401d88f4cdc0f1b109f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:47:57Z,use_quota=True,user_id='bad5953b4fbf4fe2a30a2b4208714631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:56.990669 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3f6d73-cd29-4778-9772-e1e1f763025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:56.998003 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3f6d73-cd29-4778-9772-e1e1f763025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:57.021136 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235e5697-590d-418d-ac07-0ac64d5c49bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:57.114363 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:47:57.114363 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:47:57.118378 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663eef66-cb65-42e7-a1db-aa3afd575c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:57.123347 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e423fc91-d51e-4ad6-a17d-1a411dbe6281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:57.161466 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235e5697-590d-418d-ac07-0ac64d5c49bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a48dd65-564d-450c-81a0-e653ff2aaa29', 'volume_name': 'volume-6a48dd65-564d-450c-81a0-e653ff2aaa29', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:57.168442 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee7bfd0-1c22-4285-9258-4b3bbae204b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:57.174541 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee7bfd0-1c22-4285-9258-4b3bbae204b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:57.180908 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf590c53-3052-4b9d-98a4-ad01cf77c268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:57.182377 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Volume 6a48dd65-564d-450c-81a0-e653ff2aaa29: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a48dd65-564d-450c-81a0-e653ff2aaa29', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:47:57.183123 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Cloning 6a48dd65-564d-450c-81a0-e653ff2aaa29 from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:47:57.199171 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:47:57.217597 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Volume volume-c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3 (c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3): created successfully May 02 10:47:57.221476 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e423fc91-d51e-4ad6-a17d-1a411dbe6281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:57.227221 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Flow 'volume_create_manager' (5859cb5d-bf00-48dc-836d-2b65e8d9a8f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:47:57.314306 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 47, 57, 211164)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:47:57.320404 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:47:57.320404 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:47:57.320404 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.121s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:47:57.321336 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:47:57.327865 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 47, 57, 325681)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:47:57.328372 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:47:57.328798 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:47:57.340990 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:47:57.605531 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] creating snapshot='volume-6a48dd65-564d-450c-81a0-e653ff2aaa29.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:47:59.685585 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-6a48dd65-564d-450c-81a0-e653ff2aaa29.clone_snap' to 'volume-6a48dd65-564d-450c-81a0-e653ff2aaa29' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:47:59.690890 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:47:59.691517 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:47:59.717718 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:47:59.747727 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:47:59.761055 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-05c4e122-bac1-4638-8dd0-ebbfbb394f65 tempest-VolumesListAdminTestJSON-1013683103 None] Created volume successfully. May 02 10:47:59.864219 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:47:59.884033 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Flow 'volume_create_manager' (be094ad6-d47c-4cbc-9c12-4756fcfd46fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:47:59.891983 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45461d3a-04d6-4e35-8d19-582224e08eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:59.908593 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45461d3a-04d6-4e35-8d19-582224e08eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7791e0df-2784-4dd8-a827-29d3a280b921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809e00b1c5ed41119841f22f7f028251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:47:59Z,use_quota=True,user_id='9bb1836170dc4d1185c4718cd06d8f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:59.914068 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b13cac7-219a-4176-8dc3-f0c17150ab41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:59.918231 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b13cac7-219a-4176-8dc3-f0c17150ab41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:59.923430 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f918caf6-2691-4ec5-be11-0f3e9ff0c08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:59.927704 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f918caf6-2691-4ec5-be11-0f3e9ff0c08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7791e0df-2784-4dd8-a827-29d3a280b921', 'volume_name': 'volume-7791e0df-2784-4dd8-a827-29d3a280b921', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:59.933259 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a5d21b-7175-4dbb-b40a-3695e832ceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:59.937230 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a5d21b-7175-4dbb-b40a-3695e832ceb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:47:59.942110 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a225b12-d668-4ff5-9139-9118cde41df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:47:59.943192 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Volume 7791e0df-2784-4dd8-a827-29d3a280b921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7791e0df-2784-4dd8-a827-29d3a280b921', 'volume_size': 1} May 02 10:47:59.943585 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] creating volume 'volume-7791e0df-2784-4dd8-a827-29d3a280b921' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:47:59.944249 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:00.877142 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:48:00.877831 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:48:00.882350 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a225b12-d668-4ff5-9139-9118cde41df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7791e0df-2784-4dd8-a827-29d3a280b921', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:00.888221 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396baf22-8993-40cf-8fb8-333d9537bc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:00.988225 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Volume volume-7791e0df-2784-4dd8-a827-29d3a280b921 (7791e0df-2784-4dd8-a827-29d3a280b921): created successfully May 02 10:48:00.992179 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396baf22-8993-40cf-8fb8-333d9537bc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:00.999663 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Flow 'volume_create_manager' (be094ad6-d47c-4cbc-9c12-4756fcfd46fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:01.129654 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-02a0c8af-2c41-4451-8182-71b1a2965939 tempest-VolumesListAdminTestJSON-2080304739 None] Created volume successfully. May 02 10:48:01.384448 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:48:01.386795 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:48:01.386795 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:48:01.803925 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:48:01.805659 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Marking volume 6a48dd65-564d-450c-81a0-e653ff2aaa29 as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:48:01.829088 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-68602447-d202-4a84-881e-c3036e243b2c tempest-VolumesListAdminTestJSON-2080304739 None] Lock "b'cinder-7791e0df-2784-4dd8-a827-29d3a280b921-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:01.949411 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 6a48dd65-564d-450c-81a0-e653ff2aaa29. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:48:01.949874 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Creating volume glance metadata for volume 6a48dd65-564d-450c-81a0-e653ff2aaa29 backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:48:01.982929 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-68602447-d202-4a84-881e-c3036e243b2c tempest-VolumesListAdminTestJSON-2080304739 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:02.180570 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-68602447-d202-4a84-881e-c3036e243b2c tempest-VolumesListAdminTestJSON-2080304739 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:48:02.181082 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-68602447-d202-4a84-881e-c3036e243b2c tempest-VolumesListAdminTestJSON-2080304739 None] Volume volume-7791e0df-2784-4dd8-a827-29d3a280b921 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:48:02.308327 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-68602447-d202-4a84-881e-c3036e243b2c tempest-VolumesListAdminTestJSON-2080304739 None] deleting rbd volume volume-7791e0df-2784-4dd8-a827-29d3a280b921 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:48:02.333360 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-5d855d5a-f0f8-4e01-9948-2f1cd8983c9f tempest-VolumesListAdminTestJSON-1013683103 None] Lock "b'cinder-c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:02.519380 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5d855d5a-f0f8-4e01-9948-2f1cd8983c9f tempest-VolumesListAdminTestJSON-1013683103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:02.759762 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5d855d5a-f0f8-4e01-9948-2f1cd8983c9f tempest-VolumesListAdminTestJSON-1013683103 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:48:02.760191 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5d855d5a-f0f8-4e01-9948-2f1cd8983c9f tempest-VolumesListAdminTestJSON-1013683103 None] Volume volume-c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:48:03.005631 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5d855d5a-f0f8-4e01-9948-2f1cd8983c9f tempest-VolumesListAdminTestJSON-1013683103 None] deleting rbd volume volume-c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:48:03.019755 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf590c53-3052-4b9d-98a4-ad01cf77c268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a48dd65-564d-450c-81a0-e653ff2aaa29', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:03.024712 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ef3c22-f15c-4a26-9422-4fcdfe149efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:03.132806 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Volume volume-6a48dd65-564d-450c-81a0-e653ff2aaa29 (6a48dd65-564d-450c-81a0-e653ff2aaa29): created successfully May 02 10:48:03.141193 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ef3c22-f15c-4a26-9422-4fcdfe149efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:03.150293 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Flow 'volume_create_manager' (86a6961c-a6d1-4d52-8796-341c321de049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:03.173657 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:48:03.204527 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Flow 'volume_create_manager' (57a827a2-9fde-4f41-b634-08a9e025354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:03.211540 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7215caa-8796-407d-a93c-c08b5aac6356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:03.227119 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7215caa-8796-407d-a93c-c08b5aac6356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1086019245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=093f3241-0113-4c40-ac60-da8e8ae38bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23dc31c03ada4eba97ae47aab53487d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:48:02Z,use_quota=True,user_id='f58c631280fb4cdb917abc34660e3325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:03.233361 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a8ea36-d339-460b-b20d-ef5ed75cdb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:03.237590 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a8ea36-d339-460b-b20d-ef5ed75cdb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:03.246300 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb9de9f-33bf-407e-a39e-85702c7fd27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:03.262494 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-26d06a1a-ef2e-4fe2-a0be-016052173a6a tempest-TestVolumeBootPattern-406823548 None] Created volume successfully. May 02 10:48:03.355350 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb9de9f-33bf-407e-a39e-85702c7fd27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '093f3241-0113-4c40-ac60-da8e8ae38bd8', 'volume_name': 'volume-093f3241-0113-4c40-ac60-da8e8ae38bd8', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:03.361160 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d31aef7-889c-4e18-b1fa-cd90c93f22e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:03.365263 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d31aef7-889c-4e18-b1fa-cd90c93f22e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:03.370686 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611af5a7-17ef-48ca-b835-b9450c5f110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:03.381373 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Volume 093f3241-0113-4c40-ac60-da8e8ae38bd8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-093f3241-0113-4c40-ac60-da8e8ae38bd8', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:48:03.381373 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Cloning 093f3241-0113-4c40-ac60-da8e8ae38bd8 from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:48:03.390460 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:03.462237 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 48, 3, 394208)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:48:03.462668 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:48:03.463079 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:48:03.467446 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.077s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:48:03.468126 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:48:03.473889 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 48, 3, 471615)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:48:03.474308 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:48:03.474705 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:48:03.486245 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:03.637788 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] creating snapshot='volume-093f3241-0113-4c40-ac60-da8e8ae38bd8.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:48:06.324705 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-093f3241-0113-4c40-ac60-da8e8ae38bd8.clone_snap' to 'volume-093f3241-0113-4c40-ac60-da8e8ae38bd8' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:48:06.420748 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3a787bc0-046c-49d9-b45b-bc29034fad4d tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:08.073023 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:48:08.074330 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:48:08.074802 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:48:08.714857 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:48:08.715688 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Marking volume 093f3241-0113-4c40-ac60-da8e8ae38bd8 as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:48:08.805719 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 093f3241-0113-4c40-ac60-da8e8ae38bd8. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:48:08.806779 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Creating volume glance metadata for volume 093f3241-0113-4c40-ac60-da8e8ae38bd8 backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:48:09.037326 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611af5a7-17ef-48ca-b835-b9450c5f110c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093f3241-0113-4c40-ac60-da8e8ae38bd8', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:09.042229 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a039e7a6-248b-4f8f-a518-3fd824a19aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:09.186728 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Volume volume-093f3241-0113-4c40-ac60-da8e8ae38bd8 (093f3241-0113-4c40-ac60-da8e8ae38bd8): created successfully May 02 10:48:09.186728 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a039e7a6-248b-4f8f-a518-3fd824a19aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:09.192542 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Flow 'volume_create_manager' (57a827a2-9fde-4f41-b634-08a9e025354d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:09.297495 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-ad61245a-c679-498f-859c-6278bdc13860 tempest-VolumesSnapshotTestJSON-616137826 None] Created volume successfully. May 02 10:48:09.750578 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-68602447-d202-4a84-881e-c3036e243b2c tempest-VolumesListAdminTestJSON-2080304739 None] Created reservations ['a90b1d64-cf08-436a-9300-9325bce80fb3', 'f50ba294-e214-4f25-8b49-938592915726', '91a9697e-abc0-4bf4-8c63-ff4755c1ec05', 'b55a2ebe-e7e9-4101-a7c5-a357a1b625fc'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:48:09.863307 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:48:09.883241 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Flow 'volume_create_manager' (72df441f-fbf7-4c03-958f-2ba45f30c5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:09.890576 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6fa868-a6a7-4779-9766-52da62420df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:09.912276 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6fa868-a6a7-4779-9766-52da62420df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-589102929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ad2018ec-4624-4ab9-b6e3-f53d994111da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014235b8daef456e97692382aac97d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:48:10Z,use_quota=True,user_id='1ca6e4cc7551419a9c5104419cd4b015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:09.917788 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad964b4-861c-44b5-9561-2791f1077295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:09.921944 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad964b4-861c-44b5-9561-2791f1077295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:09.927075 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f726208e-e590-49d1-b56e-61ec12cbfc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:09.931284 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f726208e-e590-49d1-b56e-61ec12cbfc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad2018ec-4624-4ab9-b6e3-f53d994111da', 'volume_name': 'volume-ad2018ec-4624-4ab9-b6e3-f53d994111da', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:09.936240 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ea9836-e7de-46ee-906c-19f6f3bcd630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:09.940278 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ea9836-e7de-46ee-906c-19f6f3bcd630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:09.945091 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea3a5fb-9b9c-4c10-8a93-6c0257bb3a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:09.946173 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Volume ad2018ec-4624-4ab9-b6e3-f53d994111da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad2018ec-4624-4ab9-b6e3-f53d994111da', 'volume_size': 1} May 02 10:48:09.946562 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] creating volume 'volume-ad2018ec-4624-4ab9-b6e3-f53d994111da' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:48:09.947581 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:10.055670 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3a787bc0-046c-49d9-b45b-bc29034fad4d tempest-TestVolumeBootPattern-406823548 None] Create snapshot completed successfully May 02 10:48:10.087635 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-68602447-d202-4a84-881e-c3036e243b2c tempest-VolumesListAdminTestJSON-2080304739 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:10.131921 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-68602447-d202-4a84-881e-c3036e243b2c tempest-VolumesListAdminTestJSON-2080304739 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:10.169891 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-68602447-d202-4a84-881e-c3036e243b2c tempest-VolumesListAdminTestJSON-2080304739 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:48:10.177247 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-68602447-d202-4a84-881e-c3036e243b2c tempest-VolumesListAdminTestJSON-2080304739 None] Deleted volume successfully. May 02 10:48:10.257120 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-5d855d5a-f0f8-4e01-9948-2f1cd8983c9f tempest-VolumesListAdminTestJSON-1013683103 None] Created reservations ['14d57744-0af9-4682-a788-887039421894', 'd2d4f4af-a8bf-4531-8a20-1f7b1c42b516', 'cc6905db-d914-49f9-aa96-da26efcba7e2', 'ea3d7e21-5ae3-4025-bf46-81cfdcce9cd3'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:48:10.271319 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-68602447-d202-4a84-881e-c3036e243b2c tempest-VolumesListAdminTestJSON-2080304739 None] Lock "b'cinder-7791e0df-2784-4dd8-a827-29d3a280b921-delete_volume'" released by "delete_volume" :: held 8.438s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:48:10.457133 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5d855d5a-f0f8-4e01-9948-2f1cd8983c9f tempest-VolumesListAdminTestJSON-1013683103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:10.487950 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5d855d5a-f0f8-4e01-9948-2f1cd8983c9f tempest-VolumesListAdminTestJSON-1013683103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:10.529825 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-5d855d5a-f0f8-4e01-9948-2f1cd8983c9f tempest-VolumesListAdminTestJSON-1013683103 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:48:10.531740 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5d855d5a-f0f8-4e01-9948-2f1cd8983c9f tempest-VolumesListAdminTestJSON-1013683103 None] Deleted volume successfully. May 02 10:48:10.579042 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:48:10.579658 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:48:10.583718 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea3a5fb-9b9c-4c10-8a93-6c0257bb3a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2018ec-4624-4ab9-b6e3-f53d994111da', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:10.588562 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e1b0a3-55bd-42e5-84fe-18d190753c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:10.660623 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-5d855d5a-f0f8-4e01-9948-2f1cd8983c9f tempest-VolumesListAdminTestJSON-1013683103 None] Lock "b'cinder-c3e5e6e0-2d52-4f10-b9b9-60219c12f9f3-delete_volume'" released by "delete_volume" :: held 8.330s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:48:10.680926 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Volume volume-ad2018ec-4624-4ab9-b6e3-f53d994111da (ad2018ec-4624-4ab9-b6e3-f53d994111da): created successfully May 02 10:48:10.695816 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e1b0a3-55bd-42e5-84fe-18d190753c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:10.702411 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Flow 'volume_create_manager' (72df441f-fbf7-4c03-958f-2ba45f30c5e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:10.755057 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-376c1d99-bce4-46fb-92ed-aa8d2ad353c7 tempest-VolumesListAdminTestJSON-1013683103 None] Lock "b'cinder-4f8d4166-93d4-4ab9-b28f-81cef79f7fa0-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:10.849540 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a51bd46e-3317-449b-ba0e-5f47c29434bd tempest-AttachVolumeShelveTestJSON-1117806735 None] Created volume successfully. May 02 10:48:10.901554 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-376c1d99-bce4-46fb-92ed-aa8d2ad353c7 tempest-VolumesListAdminTestJSON-1013683103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:11.085559 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-376c1d99-bce4-46fb-92ed-aa8d2ad353c7 tempest-VolumesListAdminTestJSON-1013683103 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:48:11.085998 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-376c1d99-bce4-46fb-92ed-aa8d2ad353c7 tempest-VolumesListAdminTestJSON-1013683103 None] Volume volume-4f8d4166-93d4-4ab9-b28f-81cef79f7fa0 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:48:11.194310 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-376c1d99-bce4-46fb-92ed-aa8d2ad353c7 tempest-VolumesListAdminTestJSON-1013683103 None] deleting rbd volume volume-4f8d4166-93d4-4ab9-b28f-81cef79f7fa0 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:48:11.210888 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-61f04a5a-792c-4a08-8bf9-861096273313 req-ea5685ee-47b4-4067-86ae-09b19948e7dc tempest-VolumesSnapshotTestJSON-616137826 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:48:11.962694 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-61f04a5a-792c-4a08-8bf9-861096273313 req-ea5685ee-47b4-4067-86ae-09b19948e7dc tempest-VolumesSnapshotTestJSON-616137826 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.751s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:48:11.963868 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-61f04a5a-792c-4a08-8bf9-861096273313 req-ea5685ee-47b4-4067-86ae-09b19948e7dc tempest-VolumesSnapshotTestJSON-616137826 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-093f3241-0113-4c40-ac60-da8e8ae38bd8', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '093f3241-0113-4c40-ac60-da8e8ae38bd8', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:48:12.085799 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-61f04a5a-792c-4a08-8bf9-861096273313 req-ea5685ee-47b4-4067-86ae-09b19948e7dc tempest-VolumesSnapshotTestJSON-616137826 None] Connection info returned from driver {'name': 'volumes/volume-093f3241-0113-4c40-ac60-da8e8ae38bd8', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '093f3241-0113-4c40-ac60-da8e8ae38bd8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '706a8c6c-fe0c-435a-927f-9888bf164c90'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:48:12.213563 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-61f04a5a-792c-4a08-8bf9-861096273313 req-ea5685ee-47b4-4067-86ae-09b19948e7dc tempest-VolumesSnapshotTestJSON-616137826 None] attachment_update completed successfully. May 02 10:48:15.222863 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-376c1d99-bce4-46fb-92ed-aa8d2ad353c7 tempest-VolumesListAdminTestJSON-1013683103 None] Created reservations ['e91f8de9-a072-4ad7-97eb-4ed8619e5095', 'dfc7cfa3-a365-4753-ace1-b8130be6b6f6', 'd4003b7a-dead-4ca2-99ae-27b20d34e92c', '41dee89f-eac8-4300-b331-264e2e12098b'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:48:15.511592 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-376c1d99-bce4-46fb-92ed-aa8d2ad353c7 tempest-VolumesListAdminTestJSON-1013683103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:15.561195 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-376c1d99-bce4-46fb-92ed-aa8d2ad353c7 tempest-VolumesListAdminTestJSON-1013683103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:15.589096 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-376c1d99-bce4-46fb-92ed-aa8d2ad353c7 tempest-VolumesListAdminTestJSON-1013683103 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:48:15.613986 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-376c1d99-bce4-46fb-92ed-aa8d2ad353c7 tempest-VolumesListAdminTestJSON-1013683103 None] Deleted volume successfully. May 02 10:48:15.707291 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-376c1d99-bce4-46fb-92ed-aa8d2ad353c7 tempest-VolumesListAdminTestJSON-1013683103 None] Lock "b'cinder-4f8d4166-93d4-4ab9-b28f-81cef79f7fa0-delete_volume'" released by "delete_volume" :: held 4.952s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:48:15.839748 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-58b63976-7c1c-4b15-92d1-2bfccb1569a0 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:16.391846 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-fe9e2711-62d5-4eac-8989-7e41bc48cd39 tempest-VolumesListAdminTestJSON-1013683103 None] Lock "b'cinder-de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:16.430592 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:48:16.459101 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Flow 'volume_create_manager' (32f4ed2d-4012-4cc0-a2dd-32d0a002916d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:16.465622 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400b4cd2-cc36-4907-8549-615d15f5dd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:16.481307 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400b4cd2-cc36-4907-8549-615d15f5dd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:48:16Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=04a608db-c011-4c76-b608-00f8454c4c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a92939abc5401d88f4cdc0f1b109f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c849588b-c81a-4c3d-a0bd-1ba2efea459f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:48:16Z,use_quota=True,user_id='bad5953b4fbf4fe2a30a2b4208714631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:16.486952 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18830b2-0592-44ca-9757-76d29ebfa5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:16.493351 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18830b2-0592-44ca-9757-76d29ebfa5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:16.496259 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1399bd7-eda9-4074-bbb3-74e046f76479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:16.500960 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1399bd7-eda9-4074-bbb3-74e046f76479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '04a608db-c011-4c76-b608-00f8454c4c73', 'volume_name': 'volume-04a608db-c011-4c76-b608-00f8454c4c73', 'volume_size': 1, 'snapshot_id': 'c849588b-c81a-4c3d-a0bd-1ba2efea459f'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:16.506182 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58be2494-088e-4ee6-8e0f-9e3d049698bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:16.510247 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58be2494-088e-4ee6-8e0f-9e3d049698bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:16.515071 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3d52cb-adb4-4616-934b-4014e204d4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:16.516788 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Volume 04a608db-c011-4c76-b608-00f8454c4c73: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-04a608db-c011-4c76-b608-00f8454c4c73', 'volume_size': 1, 'snapshot_id': 'c849588b-c81a-4c3d-a0bd-1ba2efea459f'} May 02 10:48:16.538138 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] cloning volumes/volume-6a48dd65-564d-450c-81a0-e653ff2aaa29@snapshot-c849588b-c81a-4c3d-a0bd-1ba2efea459f to volume-04a608db-c011-4c76-b608-00f8454c4c73 {{(pid=123784) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 02 10:48:16.538823 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:16.639581 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:16.739923 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fe9e2711-62d5-4eac-8989-7e41bc48cd39 tempest-VolumesListAdminTestJSON-1013683103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:17.022923 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fe9e2711-62d5-4eac-8989-7e41bc48cd39 tempest-VolumesListAdminTestJSON-1013683103 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:48:17.023526 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fe9e2711-62d5-4eac-8989-7e41bc48cd39 tempest-VolumesListAdminTestJSON-1013683103 None] Volume volume-de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:48:17.308706 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fe9e2711-62d5-4eac-8989-7e41bc48cd39 tempest-VolumesListAdminTestJSON-1013683103 None] deleting rbd volume volume-de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:48:18.690988 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:48:18.691667 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:48:18.706797 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Marking volume 04a608db-c011-4c76-b608-00f8454c4c73 as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:48:18.793833 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Copying metadata from snapshot c849588b-c81a-4c3d-a0bd-1ba2efea459f to 04a608db-c011-4c76-b608-00f8454c4c73. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} May 02 10:48:18.947747 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3d52cb-adb4-4616-934b-4014e204d4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a608db-c011-4c76-b608-00f8454c4c73', 'volume_size': 1, 'snapshot_id': 'c849588b-c81a-4c3d-a0bd-1ba2efea459f'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:18.953587 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195d2868-6e0e-421b-8eac-3cf45fd77736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:19.040054 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Volume volume-04a608db-c011-4c76-b608-00f8454c4c73 (04a608db-c011-4c76-b608-00f8454c4c73): created successfully May 02 10:48:19.044378 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195d2868-6e0e-421b-8eac-3cf45fd77736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:19.050050 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Flow 'volume_create_manager' (32f4ed2d-4012-4cc0-a2dd-32d0a002916d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:19.166432 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-5f53738f-e492-43df-96e3-b48e77ef8fc4 tempest-TestVolumeBootPattern-406823548 None] Created volume successfully. May 02 10:48:19.194907 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-58b63976-7c1c-4b15-92d1-2bfccb1569a0 tempest-VolumesSnapshotTestJSON-616137826 None] Create snapshot completed successfully May 02 10:48:19.837047 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-56900860-47fb-4214-8739-8dd403ba7669 tempest-TestVolumeBootPattern-406823548 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:48:20.332876 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a5ad4ad2-18de-4f7a-ac8b-588f298d0004 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:20.645771 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-56900860-47fb-4214-8739-8dd403ba7669 tempest-TestVolumeBootPattern-406823548 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.809s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:48:20.646436 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-56900860-47fb-4214-8739-8dd403ba7669 tempest-TestVolumeBootPattern-406823548 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-04a608db-c011-4c76-b608-00f8454c4c73', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '04a608db-c011-4c76-b608-00f8454c4c73', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:48:20.760094 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-56900860-47fb-4214-8739-8dd403ba7669 tempest-TestVolumeBootPattern-406823548 None] Connection info returned from driver {'name': 'volumes/volume-04a608db-c011-4c76-b608-00f8454c4c73', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '04a608db-c011-4c76-b608-00f8454c4c73', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fe7d5dce-40f2-4991-908b-82268562fb4f'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:48:20.896897 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-0b8fd745-dca4-4f20-b4fd-042e1afc4098 req-56900860-47fb-4214-8739-8dd403ba7669 tempest-TestVolumeBootPattern-406823548 None] attachment_update completed successfully. May 02 10:48:22.742649 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-fe9e2711-62d5-4eac-8989-7e41bc48cd39 tempest-VolumesListAdminTestJSON-1013683103 None] Created reservations ['2b02afde-7bbd-4e3c-89d4-fd93fba00e7e', 'd4e98a4a-400d-4142-8103-551c1a0fd716', '935dfb21-76c6-4db7-b638-01d4135bc2bf', 'a4d1b9e6-5811-449b-b349-b704bfb3064d'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:48:22.934767 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fe9e2711-62d5-4eac-8989-7e41bc48cd39 tempest-VolumesListAdminTestJSON-1013683103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:22.975556 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fe9e2711-62d5-4eac-8989-7e41bc48cd39 tempest-VolumesListAdminTestJSON-1013683103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:23.035164 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-fe9e2711-62d5-4eac-8989-7e41bc48cd39 tempest-VolumesListAdminTestJSON-1013683103 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:48:23.044835 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-fe9e2711-62d5-4eac-8989-7e41bc48cd39 tempest-VolumesListAdminTestJSON-1013683103 None] Deleted volume successfully. May 02 10:48:23.151044 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-fe9e2711-62d5-4eac-8989-7e41bc48cd39 tempest-VolumesListAdminTestJSON-1013683103 None] Lock "b'cinder-de161fc4-a02e-4bd7-9a5b-ef9c4a7a37b2-delete_volume'" released by "delete_volume" :: held 6.758s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:48:23.212809 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:48:23.232704 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Flow 'volume_create_manager' (5673dfe3-d270-43e1-823a-caa6f7121644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:23.240421 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80310ded-3550-489a-880d-97e7af004551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:23.245295 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a5ad4ad2-18de-4f7a-ac8b-588f298d0004 tempest-VolumesSnapshotTestJSON-616137826 None] Create snapshot completed successfully May 02 10:48:23.259612 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80310ded-3550-489a-880d-97e7af004551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1236091773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8a054d49-c87b-484b-a5c0-2ea58955590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8045ed60794216be781bda3c42b614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:48:23Z,use_quota=True,user_id='c4f23489acf14e5b941be884d1b24797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:23.265199 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a957ea2-d2b0-4c92-94cd-54bf4471d967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:23.269331 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a957ea2-d2b0-4c92-94cd-54bf4471d967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:23.274415 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb6b99d2-d23d-40f9-8eea-a7f10edc6e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:23.278481 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb6b99d2-d23d-40f9-8eea-a7f10edc6e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a054d49-c87b-484b-a5c0-2ea58955590c', 'volume_name': 'volume-8a054d49-c87b-484b-a5c0-2ea58955590c', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:23.283917 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285e202d-2557-4cf0-bfca-d6d7a9a8c30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:23.287858 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285e202d-2557-4cf0-bfca-d6d7a9a8c30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:23.292523 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571a9d2a-f30c-42f9-a092-4563f3446212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:23.304248 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Volume 8a054d49-c87b-484b-a5c0-2ea58955590c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a054d49-c87b-484b-a5c0-2ea58955590c', 'volume_size': 1} May 02 10:48:23.304248 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] creating volume 'volume-8a054d49-c87b-484b-a5c0-2ea58955590c' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:48:23.304248 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:23.901658 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:48:23.902602 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:48:23.908428 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571a9d2a-f30c-42f9-a092-4563f3446212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a054d49-c87b-484b-a5c0-2ea58955590c', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:23.915318 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4562be2-3af6-4bcd-8249-7bc83fe2d6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:23.979376 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-99fb491b-31ff-441b-a627-d50f5479553f tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:24.201173 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Volume volume-8a054d49-c87b-484b-a5c0-2ea58955590c (8a054d49-c87b-484b-a5c0-2ea58955590c): created successfully May 02 10:48:24.205227 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4562be2-3af6-4bcd-8249-7bc83fe2d6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:24.211168 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Flow 'volume_create_manager' (5673dfe3-d270-43e1-823a-caa6f7121644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:24.304834 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-89fad78f-866a-4848-92a1-2e13f3ebcc1a req-b3e5cf04-63c8-4d97-b51b-456fe77ba9c0 tempest-VolumesSnapshotsTestJSON-130013503 None] Created volume successfully. May 02 10:48:25.718259 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-28c7badc-8ce6-4a01-917d-d1afc2644997 req-694580f2-957f-404d-9cf1-b5cfb6bd74d5 tempest-VolumesSnapshotsTestJSON-130013503 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:26.846444 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-99fb491b-31ff-441b-a627-d50f5479553f tempest-VolumesSnapshotTestJSON-616137826 None] Create snapshot completed successfully May 02 10:48:27.030098 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-20183910-2ecf-4e42-8974-f091a5cd012d tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-f2f0245e-5df1-44e0-9beb-469deb133ef8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:27.032166 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-20183910-2ecf-4e42-8974-f091a5cd012d tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:29.439121 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-28c7badc-8ce6-4a01-917d-d1afc2644997 req-694580f2-957f-404d-9cf1-b5cfb6bd74d5 tempest-VolumesSnapshotsTestJSON-130013503 None] Create snapshot completed successfully May 02 10:48:30.251320 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-759f6ff6-8334-451b-9956-7d4e1c0b0f92 req-0f0f66be-aca6-4dc4-879b-2b3135ebba8e tempest-VolumesSnapshotsTestJSON-130013503 None] Lock "b'cinder-05cbd6b4-0da2-43be-8673-ebae67274219-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:30.253049 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-759f6ff6-8334-451b-9956-7d4e1c0b0f92 req-0f0f66be-aca6-4dc4-879b-2b3135ebba8e tempest-VolumesSnapshotsTestJSON-130013503 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:34.264014 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [req-759f6ff6-8334-451b-9956-7d4e1c0b0f92 req-0f0f66be-aca6-4dc4-879b-2b3135ebba8e tempest-VolumesSnapshotsTestJSON-130013503 None] Created reservations ['562e57c5-c794-47bb-8bff-c9f2e56f8928', 'a00f894b-73df-48b5-b07f-9a6015dcbb34', 'd8c069fe-4f4b-44db-a9e5-b086b1b069ba', '251505a0-3199-4bda-b26d-2a8212007e62'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:48:34.543007 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-759f6ff6-8334-451b-9956-7d4e1c0b0f92 req-0f0f66be-aca6-4dc4-879b-2b3135ebba8e tempest-VolumesSnapshotsTestJSON-130013503 None] Delete snapshot completed successfully. May 02 10:48:34.555265 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-759f6ff6-8334-451b-9956-7d4e1c0b0f92 req-0f0f66be-aca6-4dc4-879b-2b3135ebba8e tempest-VolumesSnapshotsTestJSON-130013503 None] Lock "b'cinder-05cbd6b4-0da2-43be-8673-ebae67274219-delete_snapshot'" released by "delete_snapshot" :: held 4.303s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:48:35.075421 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-3c7ef6c9-cb73-4bd2-bc42-d0914b9d5709 req-d0da9847-fcb7-4f45-a0c4-323364fbf415 tempest-VolumesSnapshotsTestJSON-130013503 None] Lock "b'cinder-8a054d49-c87b-484b-a5c0-2ea58955590c-delete_volume'" acquired by "delete_volume" :: waited 0.054s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:35.175013 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-b8f314c5-316c-42ba-ae08-2bd363533609 req-a8113855-88a6-4d49-b6a2-d716368057a4 tempest-TestVolumeBootPattern-406823548 None] Terminate volume connection completed successfully. May 02 10:48:35.176578 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-b8f314c5-316c-42ba-ae08-2bd363533609 req-a8113855-88a6-4d49-b6a2-d716368057a4 tempest-TestVolumeBootPattern-406823548 None] Deleting attachment fe7d5dce-40f2-4991-908b-82268562fb4f. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:48:35.289773 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-3c7ef6c9-cb73-4bd2-bc42-d0914b9d5709 req-d0da9847-fcb7-4f45-a0c4-323364fbf415 tempest-VolumesSnapshotsTestJSON-130013503 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:35.503068 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-3c7ef6c9-cb73-4bd2-bc42-d0914b9d5709 req-d0da9847-fcb7-4f45-a0c4-323364fbf415 tempest-VolumesSnapshotsTestJSON-130013503 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:48:35.503580 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-3c7ef6c9-cb73-4bd2-bc42-d0914b9d5709 req-d0da9847-fcb7-4f45-a0c4-323364fbf415 tempest-VolumesSnapshotsTestJSON-130013503 None] Volume volume-8a054d49-c87b-484b-a5c0-2ea58955590c is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:48:36.023623 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-3c7ef6c9-cb73-4bd2-bc42-d0914b9d5709 req-d0da9847-fcb7-4f45-a0c4-323364fbf415 tempest-VolumesSnapshotsTestJSON-130013503 None] deleting rbd volume volume-8a054d49-c87b-484b-a5c0-2ea58955590c {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:48:36.069639 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-b8f314c5-316c-42ba-ae08-2bd363533609 req-2e6a5e19-2f6e-4459-9435-b4940c629749 tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-04a608db-c011-4c76-b608-00f8454c4c73-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:36.173494 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:48:36.195852 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Flow 'volume_create_manager' (7d5843cd-e292-4d67-bbf3-0c67714b7999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:36.203452 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbf38cf-658b-43c6-b5f9-2730f67a5777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:36.237289 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbf38cf-658b-43c6-b5f9-2730f67a5777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1243212923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b5344f29-41a6-497d-8d1d-737b2bf28910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be09b901a0dc40b3bc697abab301fd99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:48:35Z,use_quota=True,user_id='b17ff6122c8244d0a5c88ce5b041150d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:36.244845 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9a33b1-7db8-4c5e-b3ba-c9d6c859a341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:36.249499 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9a33b1-7db8-4c5e-b3ba-c9d6c859a341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:36.259163 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8d66bb-9899-4356-9ffe-5c1b9e8efada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:36.279996 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8d66bb-9899-4356-9ffe-5c1b9e8efada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5344f29-41a6-497d-8d1d-737b2bf28910', 'volume_name': 'volume-b5344f29-41a6-497d-8d1d-737b2bf28910', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:36.303318 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5baab411-395e-45fd-a331-4083fb3f179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:36.317933 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5baab411-395e-45fd-a331-4083fb3f179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:36.323433 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d78996-4856-4daf-ad4a-ee289f3a5084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:36.323884 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Volume b5344f29-41a6-497d-8d1d-737b2bf28910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5344f29-41a6-497d-8d1d-737b2bf28910', 'volume_size': 1} May 02 10:48:36.324276 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] creating volume 'volume-b5344f29-41a6-497d-8d1d-737b2bf28910' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:48:36.325086 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:36.381271 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-b8f314c5-316c-42ba-ae08-2bd363533609 req-2e6a5e19-2f6e-4459-9435-b4940c629749 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:36.742533 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-b8f314c5-316c-42ba-ae08-2bd363533609 req-2e6a5e19-2f6e-4459-9435-b4940c629749 tempest-TestVolumeBootPattern-406823548 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:48:36.922558 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-b8f314c5-316c-42ba-ae08-2bd363533609 req-2e6a5e19-2f6e-4459-9435-b4940c629749 tempest-TestVolumeBootPattern-406823548 None] deleting rbd volume volume-04a608db-c011-4c76-b608-00f8454c4c73 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:48:37.196081 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:48:37.196473 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:48:37.200580 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d78996-4856-4daf-ad4a-ee289f3a5084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5344f29-41a6-497d-8d1d-737b2bf28910', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:37.207376 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc69e6e-2c34-4784-9483-51292a9bc880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:37.472882 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Volume volume-b5344f29-41a6-497d-8d1d-737b2bf28910 (b5344f29-41a6-497d-8d1d-737b2bf28910): created successfully May 02 10:48:37.478552 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc69e6e-2c34-4784-9483-51292a9bc880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:37.488366 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Flow 'volume_create_manager' (7d5843cd-e292-4d67-bbf3-0c67714b7999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:37.619639 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-0abb6db2-7a6c-41ee-a0de-04e3a82a16c6 tempest-VolumesTransfersTest-986926704 None] Created volume successfully. May 02 10:48:40.210779 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-9c2ac8e0-6423-4e92-8301-535b1d3fc75d tempest-VolumesTransfersTest-1539146215 None] Transfer volume completed successfully. May 02 10:48:41.408067 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-eb404dbb-8085-4266-88d7-dfc81450875f tempest-VolumesTransfersTest-729173083 None] Lock "b'cinder-b5344f29-41a6-497d-8d1d-737b2bf28910-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:41.545419 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-eb404dbb-8085-4266-88d7-dfc81450875f tempest-VolumesTransfersTest-729173083 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:41.754204 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-eb404dbb-8085-4266-88d7-dfc81450875f tempest-VolumesTransfersTest-729173083 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:48:41.754717 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-eb404dbb-8085-4266-88d7-dfc81450875f tempest-VolumesTransfersTest-729173083 None] Volume volume-b5344f29-41a6-497d-8d1d-737b2bf28910 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:48:41.997082 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-eb404dbb-8085-4266-88d7-dfc81450875f tempest-VolumesTransfersTest-729173083 None] deleting rbd volume volume-b5344f29-41a6-497d-8d1d-737b2bf28910 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:48:44.314301 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [req-3c7ef6c9-cb73-4bd2-bc42-d0914b9d5709 req-d0da9847-fcb7-4f45-a0c4-323364fbf415 tempest-VolumesSnapshotsTestJSON-130013503 None] Created reservations ['77c75f6c-0992-4e3a-8336-a31a416f33bf', 'd638257b-846f-4e90-a8aa-34ab726fcda2', '82798274-2389-4f1e-b3bf-7be7a563d14f', '5ab5400d-cd2e-40ee-9de5-90968d536a17'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:48:44.543921 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-3c7ef6c9-cb73-4bd2-bc42-d0914b9d5709 req-d0da9847-fcb7-4f45-a0c4-323364fbf415 tempest-VolumesSnapshotsTestJSON-130013503 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:44.573025 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-3c7ef6c9-cb73-4bd2-bc42-d0914b9d5709 req-d0da9847-fcb7-4f45-a0c4-323364fbf415 tempest-VolumesSnapshotsTestJSON-130013503 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:44.606906 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [req-3c7ef6c9-cb73-4bd2-bc42-d0914b9d5709 req-d0da9847-fcb7-4f45-a0c4-323364fbf415 tempest-VolumesSnapshotsTestJSON-130013503 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:48:44.613648 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-3c7ef6c9-cb73-4bd2-bc42-d0914b9d5709 req-d0da9847-fcb7-4f45-a0c4-323364fbf415 tempest-VolumesSnapshotsTestJSON-130013503 None] Deleted volume successfully. May 02 10:48:44.696865 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-3c7ef6c9-cb73-4bd2-bc42-d0914b9d5709 req-d0da9847-fcb7-4f45-a0c4-323364fbf415 tempest-VolumesSnapshotsTestJSON-130013503 None] Lock "b'cinder-8a054d49-c87b-484b-a5c0-2ea58955590c-delete_volume'" released by "delete_volume" :: held 9.621s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:48:45.382837 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [req-b8f314c5-316c-42ba-ae08-2bd363533609 req-2e6a5e19-2f6e-4459-9435-b4940c629749 tempest-TestVolumeBootPattern-406823548 None] Created reservations ['3d209df6-3244-41f9-8a84-7357d0661778', '847d9f56-71cf-4a68-9371-c35c3d6cb3fc', '93de0a6d-1de7-45ef-a188-e5dee0b87e16', '2779dd0b-dc8e-4948-a44f-b697ce0b74f9'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:48:45.584530 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-b8f314c5-316c-42ba-ae08-2bd363533609 req-2e6a5e19-2f6e-4459-9435-b4940c629749 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:45.762123 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-b8f314c5-316c-42ba-ae08-2bd363533609 req-2e6a5e19-2f6e-4459-9435-b4940c629749 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:45.812751 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [req-b8f314c5-316c-42ba-ae08-2bd363533609 req-2e6a5e19-2f6e-4459-9435-b4940c629749 tempest-TestVolumeBootPattern-406823548 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:48:45.942026 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-b8f314c5-316c-42ba-ae08-2bd363533609 req-2e6a5e19-2f6e-4459-9435-b4940c629749 tempest-TestVolumeBootPattern-406823548 None] Deleted volume successfully. May 02 10:48:45.966986 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-12d4dd2d-8522-41e5-9a5e-828e432fe3a2 tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-c849588b-c81a-4c3d-a0bd-1ba2efea459f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.043s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:45.971638 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-12d4dd2d-8522-41e5-9a5e-828e432fe3a2 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:46.239472 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-b8f314c5-316c-42ba-ae08-2bd363533609 req-2e6a5e19-2f6e-4459-9435-b4940c629749 tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-04a608db-c011-4c76-b608-00f8454c4c73-delete_volume'" released by "delete_volume" :: held 10.171s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:48:48.508538 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-eb404dbb-8085-4266-88d7-dfc81450875f tempest-VolumesTransfersTest-729173083 None] Created reservations ['951cc934-ad1e-4a00-8459-2389ccf4801f', '408de2cf-d0eb-4c14-8878-bec5c824d521', '88eaeff8-51ef-4c04-8fb7-d32dfdaa8b5d', '1d7586bc-94a7-4f2e-b832-759dbeee68fe'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:48:48.726327 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-eb404dbb-8085-4266-88d7-dfc81450875f tempest-VolumesTransfersTest-729173083 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:48.750915 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-eb404dbb-8085-4266-88d7-dfc81450875f tempest-VolumesTransfersTest-729173083 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:48.774698 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-eb404dbb-8085-4266-88d7-dfc81450875f tempest-VolumesTransfersTest-729173083 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:48:48.788095 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-eb404dbb-8085-4266-88d7-dfc81450875f tempest-VolumesTransfersTest-729173083 None] Deleted volume successfully. May 02 10:48:48.937698 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-eb404dbb-8085-4266-88d7-dfc81450875f tempest-VolumesTransfersTest-729173083 None] Lock "b'cinder-b5344f29-41a6-497d-8d1d-737b2bf28910-delete_volume'" released by "delete_volume" :: held 7.529s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:48:48.959190 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-12d4dd2d-8522-41e5-9a5e-828e432fe3a2 tempest-TestVolumeBootPattern-406823548 None] Created reservations ['8d21efb9-8f80-488e-aff4-9f2654cfad70', '377e3c9e-a8da-4abc-b37d-63c2ecfb0fd5', 'a3ad0656-82ff-4ea1-846e-100da697252f', '93cc9f3f-29ea-47e1-85bf-19b17279a07b'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:48:49.394838 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-12d4dd2d-8522-41e5-9a5e-828e432fe3a2 tempest-TestVolumeBootPattern-406823548 None] Delete snapshot completed successfully. May 02 10:48:49.399450 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-12d4dd2d-8522-41e5-9a5e-828e432fe3a2 tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-c849588b-c81a-4c3d-a0bd-1ba2efea459f-delete_snapshot'" released by "delete_snapshot" :: held 3.433s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:48:49.964143 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:48:49.985786 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Flow 'volume_create_manager' (53091f98-0751-4b6f-bb93-ce3947a5a943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:49.999263 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3745ae30-d35e-4c4a-afb9-5c9f8af92f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:50.017760 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3745ae30-d35e-4c4a-afb9-5c9f8af92f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1947333945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e5761615-c534-48b3-9b31-af22b9ec272b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be09b901a0dc40b3bc697abab301fd99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:48:50Z,use_quota=True,user_id='b17ff6122c8244d0a5c88ce5b041150d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:50.023285 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebeae73-323a-4c3f-9cbd-070012dc77b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:50.027513 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebeae73-323a-4c3f-9cbd-070012dc77b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:50.042706 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b3fc37-726c-4e7a-b493-c41d70640a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:50.047305 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b3fc37-726c-4e7a-b493-c41d70640a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5761615-c534-48b3-9b31-af22b9ec272b', 'volume_name': 'volume-e5761615-c534-48b3-9b31-af22b9ec272b', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:50.052815 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a786ee0-17f5-44cc-a4f4-fdbc0129d7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:50.056708 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a786ee0-17f5-44cc-a4f4-fdbc0129d7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:50.066209 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdbbea9-ff2b-4a8b-89a9-14a64bef2f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:50.067334 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Volume e5761615-c534-48b3-9b31-af22b9ec272b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5761615-c534-48b3-9b31-af22b9ec272b', 'volume_size': 1} May 02 10:48:50.067740 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] creating volume 'volume-e5761615-c534-48b3-9b31-af22b9ec272b' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:48:50.068843 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:50.291064 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-6fbd0194-31ab-4979-9d95-f6ba0d88a12d tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-6a48dd65-564d-450c-81a0-e653ff2aaa29-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:50.394564 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6fbd0194-31ab-4979-9d95-f6ba0d88a12d tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:50.697562 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6fbd0194-31ab-4979-9d95-f6ba0d88a12d tempest-TestVolumeBootPattern-406823548 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:48:51.002674 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6fbd0194-31ab-4979-9d95-f6ba0d88a12d tempest-TestVolumeBootPattern-406823548 None] deleting rbd volume volume-6a48dd65-564d-450c-81a0-e653ff2aaa29 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:48:51.158042 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:48:51.158426 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:48:51.162524 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdbbea9-ff2b-4a8b-89a9-14a64bef2f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5761615-c534-48b3-9b31-af22b9ec272b', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:51.167595 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c9f3a7-da74-4504-84c2-57df463eaf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:48:51.210903 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Volume volume-e5761615-c534-48b3-9b31-af22b9ec272b (e5761615-c534-48b3-9b31-af22b9ec272b): created successfully May 02 10:48:51.216430 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c9f3a7-da74-4504-84c2-57df463eaf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:48:51.225345 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Flow 'volume_create_manager' (53091f98-0751-4b6f-bb93-ce3947a5a943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:48:51.331947 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f9038531-bd18-41b2-9466-e86168324da2 tempest-VolumesTransfersTest-986926704 None] Created volume successfully. May 02 10:48:51.852497 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-6b21a27a-d8d5-4d6f-a3dd-84f4f8b9f82f req-7a8d947c-1d5d-4796-9bcb-cb979692a0db tempest-AttachVolumeShelveTestJSON-1117806735 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:48:52.546664 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-6b21a27a-d8d5-4d6f-a3dd-84f4f8b9f82f req-7a8d947c-1d5d-4796-9bcb-cb979692a0db tempest-AttachVolumeShelveTestJSON-1117806735 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.694s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:48:52.548208 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-6b21a27a-d8d5-4d6f-a3dd-84f4f8b9f82f req-7a8d947c-1d5d-4796-9bcb-cb979692a0db tempest-AttachVolumeShelveTestJSON-1117806735 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ad2018ec-4624-4ab9-b6e3-f53d994111da', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'ad2018ec-4624-4ab9-b6e3-f53d994111da', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:48:52.685936 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-6b21a27a-d8d5-4d6f-a3dd-84f4f8b9f82f req-7a8d947c-1d5d-4796-9bcb-cb979692a0db tempest-AttachVolumeShelveTestJSON-1117806735 None] Connection info returned from driver {'name': 'volumes/volume-ad2018ec-4624-4ab9-b6e3-f53d994111da', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ad2018ec-4624-4ab9-b6e3-f53d994111da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'de2c3fc5-2e2b-4d8e-b353-81fe49f4ae9e'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:48:52.723162 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-b0c968f8-83ba-42fc-a2b9-2cc6ff5701c2 tempest-VolumesTransfersTest-729173083 None] Lock "b'cinder-e5761615-c534-48b3-9b31-af22b9ec272b-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:48:52.811916 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-6b21a27a-d8d5-4d6f-a3dd-84f4f8b9f82f req-7a8d947c-1d5d-4796-9bcb-cb979692a0db tempest-AttachVolumeShelveTestJSON-1117806735 None] attachment_update completed successfully. May 02 10:48:52.830893 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b0c968f8-83ba-42fc-a2b9-2cc6ff5701c2 tempest-VolumesTransfersTest-729173083 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:48:53.010255 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b0c968f8-83ba-42fc-a2b9-2cc6ff5701c2 tempest-VolumesTransfersTest-729173083 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:48:53.010972 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b0c968f8-83ba-42fc-a2b9-2cc6ff5701c2 tempest-VolumesTransfersTest-729173083 None] Volume volume-e5761615-c534-48b3-9b31-af22b9ec272b is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:48:53.263841 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b0c968f8-83ba-42fc-a2b9-2cc6ff5701c2 tempest-VolumesTransfersTest-729173083 None] deleting rbd volume volume-e5761615-c534-48b3-9b31-af22b9ec272b {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:48:56.463717 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6fbd0194-31ab-4979-9d95-f6ba0d88a12d tempest-TestVolumeBootPattern-406823548 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:48:56.663729 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6fbd0194-31ab-4979-9d95-f6ba0d88a12d tempest-TestVolumeBootPattern-406823548 None] deleting parent snapshot volume-6a48dd65-564d-450c-81a0-e653ff2aaa29.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:49:00.796421 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:49:00.796421 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:00.865163 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:00.923121 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:49:01.142393 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-6fbd0194-31ab-4979-9d95-f6ba0d88a12d tempest-TestVolumeBootPattern-406823548 None] Created reservations ['e451ab9b-1625-45c9-840e-78020f8a8aff', 'c8f8788a-abf8-422e-bf98-98c42d494117', '6b385506-6de2-4a85-940c-db615a2e1159', '3dfae724-6841-4e83-9b0a-b297d51b6b8b'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:49:01.148634 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-b0c968f8-83ba-42fc-a2b9-2cc6ff5701c2 tempest-VolumesTransfersTest-729173083 None] Created reservations ['88a1f45f-9616-4971-a7e0-63b6ad20462c', '0f9e037a-a3a5-4c08-99c9-25791f713e7a', 'e59456e8-05ce-413a-a530-cbe3c17a0a85', '37199ded-bf68-4a91-b6c5-aba340e507c6'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:49:01.251943 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-20183910-2ecf-4e42-8974-f091a5cd012d tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['29ccf2f5-a516-484a-b5a8-4ff6124d24f1', '82f7f662-4baf-4c00-ad68-ce5660b22d0f', 'ba971619-a349-4375-bde2-18ede8fe3ca7', 'd2ee0c73-ea50-434b-8e09-58d93ab21934'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:49:01.350737 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6fbd0194-31ab-4979-9d95-f6ba0d88a12d tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:01.433541 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6fbd0194-31ab-4979-9d95-f6ba0d88a12d tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:01.525941 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-6fbd0194-31ab-4979-9d95-f6ba0d88a12d tempest-TestVolumeBootPattern-406823548 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:49:01.529057 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b0c968f8-83ba-42fc-a2b9-2cc6ff5701c2 tempest-VolumesTransfersTest-729173083 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:01.633744 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b0c968f8-83ba-42fc-a2b9-2cc6ff5701c2 tempest-VolumesTransfersTest-729173083 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:01.742179 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-b0c968f8-83ba-42fc-a2b9-2cc6ff5701c2 tempest-VolumesTransfersTest-729173083 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:49:01.759186 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-6fbd0194-31ab-4979-9d95-f6ba0d88a12d tempest-TestVolumeBootPattern-406823548 None] Deleted volume successfully. May 02 10:49:01.828060 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b0c968f8-83ba-42fc-a2b9-2cc6ff5701c2 tempest-VolumesTransfersTest-729173083 None] Deleted volume successfully. May 02 10:49:01.877904 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-e97844b1-bfc3-49a4-8471-2cc82d566c61 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-ea294eb1-a3bc-4063-aabf-16055d88ae54-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:49:01.877904 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e97844b1-bfc3-49a4-8471-2cc82d566c61 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:02.155711 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-20183910-2ecf-4e42-8974-f091a5cd012d tempest-VolumesSnapshotTestJSON-616137826 None] Delete snapshot completed successfully. May 02 10:49:02.165756 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-20183910-2ecf-4e42-8974-f091a5cd012d tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-f2f0245e-5df1-44e0-9beb-469deb133ef8-delete_snapshot'" released by "delete_snapshot" :: held 35.135s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:49:02.177617 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-6fbd0194-31ab-4979-9d95-f6ba0d88a12d tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-6a48dd65-564d-450c-81a0-e653ff2aaa29-delete_volume'" released by "delete_volume" :: held 11.886s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:49:02.182802 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-b0c968f8-83ba-42fc-a2b9-2cc6ff5701c2 tempest-VolumesTransfersTest-729173083 None] Lock "b'cinder-e5761615-c534-48b3-9b31-af22b9ec272b-delete_volume'" released by "delete_volume" :: held 9.458s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:49:02.838582 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:49:02.874015 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Flow 'volume_create_manager' (40275edf-e264-4e8d-bed3-23a677170313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:49:02.884972 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d51e5b-ef19-46df-ac5a-d0346a337eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:02.903814 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d51e5b-ef19-46df-ac5a-d0346a337eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1291550086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9c3200c8-66a8-41af-bf6f-4afaf390d46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a92939abc5401d88f4cdc0f1b109f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:49:03Z,use_quota=True,user_id='bad5953b4fbf4fe2a30a2b4208714631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:02.912528 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9b64fc-ff04-40b2-af7a-17514cc597a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:02.917816 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9b64fc-ff04-40b2-af7a-17514cc597a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:02.923977 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39dc624e-704c-4717-ab99-aadb44b71a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:03.059326 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39dc624e-704c-4717-ab99-aadb44b71a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c3200c8-66a8-41af-bf6f-4afaf390d46e', 'volume_name': 'volume-9c3200c8-66a8-41af-bf6f-4afaf390d46e', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:03.065605 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcefdf4-deb9-435f-a563-331a4163375b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:03.071955 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcefdf4-deb9-435f-a563-331a4163375b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:03.075888 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91b2a80-58dc-4af7-a9ac-4e379754af34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:03.079930 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Volume 9c3200c8-66a8-41af-bf6f-4afaf390d46e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c3200c8-66a8-41af-bf6f-4afaf390d46e', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:49:03.079930 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Cloning 9c3200c8-66a8-41af-bf6f-4afaf390d46e from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:49:03.107534 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.028s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:49:03.195986 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 49, 3, 113507)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:49:03.196435 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:49:03.196870 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:49:03.206856 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.100s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:49:03.207870 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:49:03.219659 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 49, 3, 213609)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:49:03.220333 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:49:03.221848 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:49:03.240119 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:04.245800 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] creating snapshot='volume-9c3200c8-66a8-41af-bf6f-4afaf390d46e.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:49:06.607537 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-9c3200c8-66a8-41af-bf6f-4afaf390d46e.clone_snap' to 'volume-9c3200c8-66a8-41af-bf6f-4afaf390d46e' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:49:07.767487 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:49:07.769038 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:49:07.770587 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:49:08.171726 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:49:08.172877 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Marking volume 9c3200c8-66a8-41af-bf6f-4afaf390d46e as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:49:08.223363 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 9c3200c8-66a8-41af-bf6f-4afaf390d46e. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:49:08.223779 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Creating volume glance metadata for volume 9c3200c8-66a8-41af-bf6f-4afaf390d46e backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:49:08.353113 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91b2a80-58dc-4af7-a9ac-4e379754af34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3200c8-66a8-41af-bf6f-4afaf390d46e', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:08.358520 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec46894-5012-4dc7-9e03-7bf2c1cb670d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:08.427602 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Volume volume-9c3200c8-66a8-41af-bf6f-4afaf390d46e (9c3200c8-66a8-41af-bf6f-4afaf390d46e): created successfully May 02 10:49:08.431394 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec46894-5012-4dc7-9e03-7bf2c1cb670d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:08.437125 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Flow 'volume_create_manager' (40275edf-e264-4e8d-bed3-23a677170313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:49:08.514165 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5f070793-f906-484a-9f86-879fc7589625 tempest-TestVolumeBootPattern-406823548 None] Created volume successfully. May 02 10:49:13.547493 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-28690134-58f1-418a-99ca-463798e8588b req-6d736a5c-bcd0-4f2e-b975-1b0234d441ff tempest-TestVolumeBootPattern-406823548 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:49:14.521296 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-28690134-58f1-418a-99ca-463798e8588b req-6d736a5c-bcd0-4f2e-b975-1b0234d441ff tempest-TestVolumeBootPattern-406823548 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.975s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:49:14.522308 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-28690134-58f1-418a-99ca-463798e8588b req-6d736a5c-bcd0-4f2e-b975-1b0234d441ff tempest-TestVolumeBootPattern-406823548 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9c3200c8-66a8-41af-bf6f-4afaf390d46e', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '9c3200c8-66a8-41af-bf6f-4afaf390d46e', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:49:14.605293 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-28690134-58f1-418a-99ca-463798e8588b req-6d736a5c-bcd0-4f2e-b975-1b0234d441ff tempest-TestVolumeBootPattern-406823548 None] Connection info returned from driver {'name': 'volumes/volume-9c3200c8-66a8-41af-bf6f-4afaf390d46e', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9c3200c8-66a8-41af-bf6f-4afaf390d46e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c3ddbf6d-44f6-48d2-bb05-e9aba489160e'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:49:14.761573 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-28690134-58f1-418a-99ca-463798e8588b req-6d736a5c-bcd0-4f2e-b975-1b0234d441ff tempest-TestVolumeBootPattern-406823548 None] attachment_update completed successfully. May 02 10:49:30.398337 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0811d7d5-fa3c-430b-be9a-1f27a6f6f790 req-acc77004-eda5-4c62-8c5c-21ae02e05cbb tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:31.179972 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:49:31.206482 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Flow 'volume_create_manager' (bee4f02d-1326-43fb-a8d2-524d6faebbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:49:31.211130 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc5fb9d-0b75-40b2-a412-3279602d7564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:31.228026 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc5fb9d-0b75-40b2-a412-3279602d7564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1150692724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=453a04f5-f8a1-4fc6-ba94-a74125e71e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2257323c692e4608b9a5468b7aa57846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:49:31Z,use_quota=True,user_id='bb25448d45ac488797f59e828cafdb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:31.234159 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b4e0e9-81dd-4441-975c-3c09286d8217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:31.238690 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b4e0e9-81dd-4441-975c-3c09286d8217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:31.244395 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61529c17-a564-43e7-b98a-394ec089e8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:31.249285 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61529c17-a564-43e7-b98a-394ec089e8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453a04f5-f8a1-4fc6-ba94-a74125e71e56', 'volume_name': 'volume-453a04f5-f8a1-4fc6-ba94-a74125e71e56', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:31.255423 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4032f50f-cb8f-44a3-9774-c7459fa44c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:31.259688 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4032f50f-cb8f-44a3-9774-c7459fa44c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:31.264723 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e217f329-18fc-4157-a253-e5f8a2e3cdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:31.266599 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Volume 453a04f5-f8a1-4fc6-ba94-a74125e71e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453a04f5-f8a1-4fc6-ba94-a74125e71e56', 'volume_size': 1} May 02 10:49:31.267014 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] creating volume 'volume-453a04f5-f8a1-4fc6-ba94-a74125e71e56' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:49:31.268355 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:32.273335 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:49:32.274896 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:49:32.279936 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e217f329-18fc-4157-a253-e5f8a2e3cdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453a04f5-f8a1-4fc6-ba94-a74125e71e56', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:32.287399 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76326be8-865d-4994-a256-b15d05a64983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:32.360740 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Volume volume-453a04f5-f8a1-4fc6-ba94-a74125e71e56 (453a04f5-f8a1-4fc6-ba94-a74125e71e56): created successfully May 02 10:49:32.365406 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76326be8-865d-4994-a256-b15d05a64983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:32.371863 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Flow 'volume_create_manager' (bee4f02d-1326-43fb-a8d2-524d6faebbd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:49:32.452073 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-50e58c04-f9cc-483c-99be-6b3cf40748cf tempest-AttachVolumeTestJSON-2054785600 None] Created volume successfully. May 02 10:49:33.272945 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-e97844b1-bfc3-49a4-8471-2cc82d566c61 tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['fb854ff9-6e47-4df7-992f-03a25655a5d1', '7d04ca52-fc6c-4b6e-bfa5-bca4337c0bcd', 'f7e1249d-176b-427c-a467-18da1e0c6086', '59a765fe-375a-473a-a874-35382e99d484'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:49:33.274194 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-0811d7d5-fa3c-430b-be9a-1f27a6f6f790 req-acc77004-eda5-4c62-8c5c-21ae02e05cbb tempest-TestVolumeBootPattern-406823548 None] Create snapshot completed successfully May 02 10:49:33.605252 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e97844b1-bfc3-49a4-8471-2cc82d566c61 tempest-VolumesSnapshotTestJSON-616137826 None] Delete snapshot completed successfully. May 02 10:49:33.610562 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-e97844b1-bfc3-49a4-8471-2cc82d566c61 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-ea294eb1-a3bc-4063-aabf-16055d88ae54-delete_snapshot'" released by "delete_snapshot" :: held 31.739s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:49:34.171488 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-17829bbc-017d-49b6-9895-d7e58c9fc0ea req-6b91d661-6b77-4f13-88b2-4dd5d3748873 tempest-AttachVolumeTestJSON-2054785600 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:49:34.258887 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-c51cc097-e0eb-474e-8830-3e52982951aa tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-3b2f27b1-cf08-4c5e-9d53-c863d7ed36ed-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.023s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:49:34.270188 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c51cc097-e0eb-474e-8830-3e52982951aa tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:35.077372 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-17829bbc-017d-49b6-9895-d7e58c9fc0ea req-6b91d661-6b77-4f13-88b2-4dd5d3748873 tempest-AttachVolumeTestJSON-2054785600 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.906s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:49:35.078895 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-17829bbc-017d-49b6-9895-d7e58c9fc0ea req-6b91d661-6b77-4f13-88b2-4dd5d3748873 tempest-AttachVolumeTestJSON-2054785600 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-453a04f5-f8a1-4fc6-ba94-a74125e71e56', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '453a04f5-f8a1-4fc6-ba94-a74125e71e56', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:49:35.228407 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-17829bbc-017d-49b6-9895-d7e58c9fc0ea req-6b91d661-6b77-4f13-88b2-4dd5d3748873 tempest-AttachVolumeTestJSON-2054785600 None] Connection info returned from driver {'name': 'volumes/volume-453a04f5-f8a1-4fc6-ba94-a74125e71e56', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '453a04f5-f8a1-4fc6-ba94-a74125e71e56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0ea09801-1e1c-4273-b298-8f88eef076e3'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:49:35.388797 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-17829bbc-017d-49b6-9895-d7e58c9fc0ea req-6b91d661-6b77-4f13-88b2-4dd5d3748873 tempest-AttachVolumeTestJSON-2054785600 None] attachment_update completed successfully. May 02 10:49:39.769046 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:49:39.822876 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Flow 'volume_create_manager' (00441f10-e476-4cbc-88ed-fc5a5eca3cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:49:39.831284 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b0e8df-c8dc-46b3-8207-04120736fbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:39.850886 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b0e8df-c8dc-46b3-8207-04120736fbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:49:39Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e78d29eb-b885-4e73-a017-adce8ca38aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a92939abc5401d88f4cdc0f1b109f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=54f3c95d-50a9-4d5c-8b7f-e2c1796dfa1a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:49:40Z,use_quota=True,user_id='bad5953b4fbf4fe2a30a2b4208714631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:39.857678 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc6db4f-0892-433e-8956-569a4787abf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:39.865073 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc6db4f-0892-433e-8956-569a4787abf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:39.870996 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9c942f-f608-4d69-a90e-16545a7bbff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:39.875839 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9c942f-f608-4d69-a90e-16545a7bbff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e78d29eb-b885-4e73-a017-adce8ca38aad', 'volume_name': 'volume-e78d29eb-b885-4e73-a017-adce8ca38aad', 'volume_size': 1, 'snapshot_id': '54f3c95d-50a9-4d5c-8b7f-e2c1796dfa1a'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:39.881636 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65de7bd1-3232-4024-a66f-67f51c278ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:39.885614 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65de7bd1-3232-4024-a66f-67f51c278ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:39.890828 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f304f85-f1f5-4b83-be94-484d4c38dd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:39.891941 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Volume e78d29eb-b885-4e73-a017-adce8ca38aad: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e78d29eb-b885-4e73-a017-adce8ca38aad', 'volume_size': 1, 'snapshot_id': '54f3c95d-50a9-4d5c-8b7f-e2c1796dfa1a'} May 02 10:49:39.913254 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] cloning volumes/volume-9c3200c8-66a8-41af-bf6f-4afaf390d46e@snapshot-54f3c95d-50a9-4d5c-8b7f-e2c1796dfa1a to volume-e78d29eb-b885-4e73-a017-adce8ca38aad {{(pid=123784) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 02 10:49:39.913927 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:39.974626 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:41.611105 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:49:41.611668 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:49:41.631433 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Marking volume e78d29eb-b885-4e73-a017-adce8ca38aad as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:49:41.690996 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Copying metadata from snapshot 54f3c95d-50a9-4d5c-8b7f-e2c1796dfa1a to e78d29eb-b885-4e73-a017-adce8ca38aad. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} May 02 10:49:41.786428 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f304f85-f1f5-4b83-be94-484d4c38dd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e78d29eb-b885-4e73-a017-adce8ca38aad', 'volume_size': 1, 'snapshot_id': '54f3c95d-50a9-4d5c-8b7f-e2c1796dfa1a'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:41.791154 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfffab40-d56d-4350-9943-9611cb96272c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:49:41.885418 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Volume volume-e78d29eb-b885-4e73-a017-adce8ca38aad (e78d29eb-b885-4e73-a017-adce8ca38aad): created successfully May 02 10:49:41.889357 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfffab40-d56d-4350-9943-9611cb96272c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:49:41.895027 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Flow 'volume_create_manager' (00441f10-e476-4cbc-88ed-fc5a5eca3cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:49:41.966610 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-26af8120-af93-49e9-ae7a-36d3cdd061b7 tempest-TestVolumeBootPattern-406823548 None] Created volume successfully. May 02 10:49:42.934350 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-db561447-52ef-43c6-a63a-d48da5adfed9 tempest-TestVolumeBootPattern-406823548 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:49:43.605178 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-db561447-52ef-43c6-a63a-d48da5adfed9 tempest-TestVolumeBootPattern-406823548 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.670s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:49:43.606601 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-db561447-52ef-43c6-a63a-d48da5adfed9 tempest-TestVolumeBootPattern-406823548 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e78d29eb-b885-4e73-a017-adce8ca38aad', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'e78d29eb-b885-4e73-a017-adce8ca38aad', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:49:43.709492 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-db561447-52ef-43c6-a63a-d48da5adfed9 tempest-TestVolumeBootPattern-406823548 None] Connection info returned from driver {'name': 'volumes/volume-e78d29eb-b885-4e73-a017-adce8ca38aad', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e78d29eb-b885-4e73-a017-adce8ca38aad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b07cf7ee-d632-4b55-8a97-25338a473246'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:49:43.794904 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-0277a606-8c7c-4ad1-9047-6d3efa17d4db req-db561447-52ef-43c6-a63a-d48da5adfed9 tempest-TestVolumeBootPattern-406823548 None] attachment_update completed successfully. May 02 10:49:53.028720 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-5dc9463b-1072-4605-8cc9-0f079a13f930 req-a2869255-da0e-4edc-ae29-214d94655657 tempest-AttachVolumeShelveTestJSON-1117806735 None] Terminate volume connection completed successfully. May 02 10:49:53.029403 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-5dc9463b-1072-4605-8cc9-0f079a13f930 req-a2869255-da0e-4edc-ae29-214d94655657 tempest-AttachVolumeShelveTestJSON-1117806735 None] Deleting attachment de2c3fc5-2e2b-4d8e-b353-81fe49f4ae9e. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:49:57.971555 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-c492b07b-bc8f-434b-8026-0d90b74c6c8b req-127bc002-15d6-4b96-8008-e9b6b62638fe tempest-TestVolumeBootPattern-406823548 None] Terminate volume connection completed successfully. May 02 10:49:57.972878 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-c492b07b-bc8f-434b-8026-0d90b74c6c8b req-127bc002-15d6-4b96-8008-e9b6b62638fe tempest-TestVolumeBootPattern-406823548 None] Deleting attachment b07cf7ee-d632-4b55-8a97-25338a473246. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:49:58.324571 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-c492b07b-bc8f-434b-8026-0d90b74c6c8b req-485e8c63-c7a2-42a3-956d-250c1d26e235 tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-e78d29eb-b885-4e73-a017-adce8ca38aad-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:49:58.466154 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-c492b07b-bc8f-434b-8026-0d90b74c6c8b req-485e8c63-c7a2-42a3-956d-250c1d26e235 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:49:58.738444 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-c492b07b-bc8f-434b-8026-0d90b74c6c8b req-485e8c63-c7a2-42a3-956d-250c1d26e235 tempest-TestVolumeBootPattern-406823548 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:49:59.112963 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-c492b07b-bc8f-434b-8026-0d90b74c6c8b req-485e8c63-c7a2-42a3-956d-250c1d26e235 tempest-TestVolumeBootPattern-406823548 None] deleting rbd volume volume-e78d29eb-b885-4e73-a017-adce8ca38aad {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:50:00.796086 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:50:00.796958 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:00.819919 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:00.846327 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:50:05.367162 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-c51cc097-e0eb-474e-8830-3e52982951aa tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['ab88c5fb-f332-42ff-a5dd-97337329cf8e', '15e57496-37aa-4bd4-80d6-d06ba0122096', 'f8a8ef09-4e7b-4370-9d7d-fcdab45ec4ec', '7e219fe8-f202-4de3-a975-25ce5c4319d7'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:50:05.601737 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-c51cc097-e0eb-474e-8830-3e52982951aa tempest-VolumesSnapshotTestJSON-616137826 None] Delete snapshot completed successfully. May 02 10:50:05.607135 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-c51cc097-e0eb-474e-8830-3e52982951aa tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-3b2f27b1-cf08-4c5e-9d53-c863d7ed36ed-delete_snapshot'" released by "delete_snapshot" :: held 31.352s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:50:06.115414 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [req-c492b07b-bc8f-434b-8026-0d90b74c6c8b req-485e8c63-c7a2-42a3-956d-250c1d26e235 tempest-TestVolumeBootPattern-406823548 None] Created reservations ['645cf0a5-6c14-4162-b502-a48183ccfa10', '4672a867-1306-4e1a-8625-c180a12fbc57', '3549d53c-716b-4897-888e-99fc41eb8513', '77c16db4-a7c4-4580-92f5-342822dbc252'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:50:06.349742 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-c492b07b-bc8f-434b-8026-0d90b74c6c8b req-485e8c63-c7a2-42a3-956d-250c1d26e235 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:06.385469 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-c492b07b-bc8f-434b-8026-0d90b74c6c8b req-485e8c63-c7a2-42a3-956d-250c1d26e235 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:06.408683 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [req-c492b07b-bc8f-434b-8026-0d90b74c6c8b req-485e8c63-c7a2-42a3-956d-250c1d26e235 tempest-TestVolumeBootPattern-406823548 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:50:06.413076 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-c492b07b-bc8f-434b-8026-0d90b74c6c8b req-485e8c63-c7a2-42a3-956d-250c1d26e235 tempest-TestVolumeBootPattern-406823548 None] Deleted volume successfully. May 02 10:50:06.490479 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-c492b07b-bc8f-434b-8026-0d90b74c6c8b req-485e8c63-c7a2-42a3-956d-250c1d26e235 tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-e78d29eb-b885-4e73-a017-adce8ca38aad-delete_volume'" released by "delete_volume" :: held 8.166s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:50:07.344695 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-08946d7c-eafc-47d4-8c29-ae303b9130fc req-90f45fde-235b-42c9-8637-057f91d5da1d tempest-VolumesSnapshotTestJSON-616137826 None] Terminate volume connection completed successfully. May 02 10:50:07.345108 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-08946d7c-eafc-47d4-8c29-ae303b9130fc req-90f45fde-235b-42c9-8637-057f91d5da1d tempest-VolumesSnapshotTestJSON-616137826 None] Deleting attachment 706a8c6c-fe0c-435a-927f-9888bf164c90. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:50:07.447142 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-533094d0-ba53-4781-bab6-544fa5b0edd0 tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-54f3c95d-50a9-4d5c-8b7f-e2c1796dfa1a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:50:07.449379 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-533094d0-ba53-4781-bab6-544fa5b0edd0 tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:12.515305 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-73f625a7-0a00-4e64-ba59-c709d673abc0 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:15.367064 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-73f625a7-0a00-4e64-ba59-c709d673abc0 tempest-VolumesSnapshotTestJSON-616137826 None] Create snapshot completed successfully May 02 10:50:16.714451 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-d9a6eeab-21c8-4840-8195-5b25b4aeee0b tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-3030cf69-1662-43c9-8c71-fd2ebfc2d220-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:50:16.715931 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d9a6eeab-21c8-4840-8195-5b25b4aeee0b tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:20.509882 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-d9a6eeab-21c8-4840-8195-5b25b4aeee0b tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['58ff5e16-bcdc-4a32-9af9-ecb2a1578e08', '397f318e-82c4-454b-8cd6-a43a6b58b9c5', '54b92a3a-eba0-4cc7-a988-a0c682f132ff', 'a6573c84-5fee-4741-9061-b4794dbddc66'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:50:20.668412 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-d9a6eeab-21c8-4840-8195-5b25b4aeee0b tempest-VolumesSnapshotTestJSON-616137826 None] Delete snapshot completed successfully. May 02 10:50:20.673439 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-d9a6eeab-21c8-4840-8195-5b25b4aeee0b tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-3030cf69-1662-43c9-8c71-fd2ebfc2d220-delete_snapshot'" released by "delete_snapshot" :: held 3.959s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:50:21.447113 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3d0ff4f0-453f-4772-ac08-f5c1bd86136b tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:25.016406 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3d0ff4f0-453f-4772-ac08-f5c1bd86136b tempest-VolumesSnapshotTestJSON-616137826 None] Create snapshot completed successfully May 02 10:50:36.385230 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-f330535a-2f32-4154-833b-d9d1dcc10805 req-d7b2f8c7-85b7-4507-8535-47521d5d5cdd tempest-AttachVolumeTestJSON-2054785600 None] Terminate volume connection completed successfully. May 02 10:50:36.385854 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-f330535a-2f32-4154-833b-d9d1dcc10805 req-d7b2f8c7-85b7-4507-8535-47521d5d5cdd tempest-AttachVolumeTestJSON-2054785600 None] Deleting attachment 0ea09801-1e1c-4273-b298-8f88eef076e3. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:50:38.414893 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:50:38.437035 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Flow 'volume_create_manager' (00ff9a22-2b85-4bb5-abf1-6d0d89848619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:50:38.444370 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8c9d4f-e4c5-4c9c-adee-38a56347b93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:38.459968 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8c9d4f-e4c5-4c9c-adee-38a56347b93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-845171269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=990c281c-4627-4178-a1f4-29f0afc27310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384320d476a5439a8154bbaf3bee36b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:50:38Z,use_quota=True,user_id='13f497db6e2c4700a3f32fdceb47ee1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c74b19d5-00e8-4145-9220-d157b86b8243),volume_type_id=c74b19d5-00e8-4145-9220-d157b86b8243)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:38.465383 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a631aa5-32c9-47ad-8a96-05e3a93241b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:38.469556 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a631aa5-32c9-47ad-8a96-05e3a93241b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:38.475383 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb71edd4-2958-461e-bb24-40cb8bcfcd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:38.479497 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb71edd4-2958-461e-bb24-40cb8bcfcd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '990c281c-4627-4178-a1f4-29f0afc27310', 'volume_name': 'volume-990c281c-4627-4178-a1f4-29f0afc27310', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:38.484439 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee69ff45-185c-4603-8749-b47f8dd79757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:38.488401 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee69ff45-185c-4603-8749-b47f8dd79757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:38.493206 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd4edc7-0974-4d6d-ab84-2e16c5f8bbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:38.494259 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Volume 990c281c-4627-4178-a1f4-29f0afc27310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-990c281c-4627-4178-a1f4-29f0afc27310', 'volume_size': 1} May 02 10:50:38.494657 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] creating volume 'volume-990c281c-4627-4178-a1f4-29f0afc27310' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:50:38.495434 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:38.681122 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-533094d0-ba53-4781-bab6-544fa5b0edd0 tempest-TestVolumeBootPattern-406823548 None] Created reservations ['0ec8c5a4-84d1-45ed-af81-d32efe2fb176', '5c593edc-6749-4948-b277-730d1a64531c', '97f8e33d-1b8d-4dd8-a071-f037dabdf80f', 'aace92fd-2da7-4717-b42e-d9ea2c2ee9ae'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:50:38.938241 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-533094d0-ba53-4781-bab6-544fa5b0edd0 tempest-TestVolumeBootPattern-406823548 None] Delete snapshot completed successfully. May 02 10:50:38.952941 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-533094d0-ba53-4781-bab6-544fa5b0edd0 tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-54f3c95d-50a9-4d5c-8b7f-e2c1796dfa1a-delete_snapshot'" released by "delete_snapshot" :: held 31.506s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:50:39.455712 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:50:39.456333 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:50:39.459858 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd4edc7-0974-4d6d-ab84-2e16c5f8bbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990c281c-4627-4178-a1f4-29f0afc27310', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:39.464693 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7b5a2d-d52e-4039-906c-2a8976ea1bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:39.549669 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Volume volume-990c281c-4627-4178-a1f4-29f0afc27310 (990c281c-4627-4178-a1f4-29f0afc27310): created successfully May 02 10:50:39.554015 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7b5a2d-d52e-4039-906c-2a8976ea1bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:39.560372 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Flow 'volume_create_manager' (00ff9a22-2b85-4bb5-abf1-6d0d89848619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:50:39.685960 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-d0bccc48-b21e-4302-9ad6-50478703d368 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Created volume successfully. May 02 10:50:41.030608 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4749bf21-90db-441b-ad78-48d12fb39bab tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:41.093715 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4749bf21-90db-441b-ad78-48d12fb39bab tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:41.139494 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-4749bf21-90db-441b-ad78-48d12fb39bab tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:50:41.143450 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4749bf21-90db-441b-ad78-48d12fb39bab tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Retype volume completed successfully. May 02 10:50:41.854770 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-6a45820d-e7ea-4ae0-8296-38d134c27fd6 req-6ea58c40-4d5a-4008-9510-c052a52e04ed tempest-VolumesSnapshotTestJSON-616137826 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:50:42.222394 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Lock "b'cinder-990c281c-4627-4178-a1f4-29f0afc27310-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:50:42.252144 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-071f8268-dd83-4878-8c2c-f87868193c63 req-8c088ad5-8859-4062-87d2-15927d97d2c2 tempest-TestVolumeBootPattern-406823548 None] Terminate volume connection completed successfully. May 02 10:50:42.252581 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-071f8268-dd83-4878-8c2c-f87868193c63 req-8c088ad5-8859-4062-87d2-15927d97d2c2 tempest-TestVolumeBootPattern-406823548 None] Deleting attachment c3ddbf6d-44f6-48d2-bb05-e9aba489160e. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:50:42.327484 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:42.504154 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:50:42.504703 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Volume volume-990c281c-4627-4178-a1f4-29f0afc27310 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:50:42.589416 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] deleting rbd volume volume-990c281c-4627-4178-a1f4-29f0afc27310 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:50:42.591599 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-6a45820d-e7ea-4ae0-8296-38d134c27fd6 req-6ea58c40-4d5a-4008-9510-c052a52e04ed tempest-VolumesSnapshotTestJSON-616137826 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.737s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:50:42.592221 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-6a45820d-e7ea-4ae0-8296-38d134c27fd6 req-6ea58c40-4d5a-4008-9510-c052a52e04ed tempest-VolumesSnapshotTestJSON-616137826 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f570807a-66b8-416f-b0c4-f488a0f13513', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'f570807a-66b8-416f-b0c4-f488a0f13513', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:50:42.615151 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-071f8268-dd83-4878-8c2c-f87868193c63 req-18b24924-f039-40ea-a41f-1cff9ac4770f tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-9c3200c8-66a8-41af-bf6f-4afaf390d46e-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:50:42.692871 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-6a45820d-e7ea-4ae0-8296-38d134c27fd6 req-6ea58c40-4d5a-4008-9510-c052a52e04ed tempest-VolumesSnapshotTestJSON-616137826 None] Connection info returned from driver {'name': 'volumes/volume-f570807a-66b8-416f-b0c4-f488a0f13513', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f570807a-66b8-416f-b0c4-f488a0f13513', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fbdb6dd2-1102-436b-a5de-01ae1938005b'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:50:42.731049 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-071f8268-dd83-4878-8c2c-f87868193c63 req-18b24924-f039-40ea-a41f-1cff9ac4770f tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:42.914910 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-071f8268-dd83-4878-8c2c-f87868193c63 req-18b24924-f039-40ea-a41f-1cff9ac4770f tempest-TestVolumeBootPattern-406823548 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:50:43.093910 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-071f8268-dd83-4878-8c2c-f87868193c63 req-18b24924-f039-40ea-a41f-1cff9ac4770f tempest-TestVolumeBootPattern-406823548 None] deleting rbd volume volume-9c3200c8-66a8-41af-bf6f-4afaf390d46e {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:50:43.125004 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-6a45820d-e7ea-4ae0-8296-38d134c27fd6 req-6ea58c40-4d5a-4008-9510-c052a52e04ed tempest-VolumesSnapshotTestJSON-616137826 None] attachment_update completed successfully. May 02 10:50:46.380982 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-68dca3d4-0ec3-4187-8461-16dfec7c5a70 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:48.847656 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. May 02 10:50:48.848352 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. May 02 10:50:48.887243 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-68dca3d4-0ec3-4187-8461-16dfec7c5a70 tempest-VolumesSnapshotTestJSON-616137826 None] Create snapshot completed successfully May 02 10:50:48.904201 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Created reservations ['f3604bd0-3422-477a-90fb-4017ec7b1608', '8b1782a6-9f67-4f9e-8286-26ed3be57247', 'ab1d5ed1-b38a-4bdd-ad5b-a57d8eb8ae7c', '06ca91db-cadc-42c9-8c48-98aefb6f4563'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:50:49.076079 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:49.108727 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:49.136304 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:50:49.140564 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Deleted volume successfully. May 02 10:50:49.245916 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-3e36d4ce-22bb-40ac-8e8f-2e2ea460ee00 tempest-VolumeRetypeWithoutMigrationTest-1684537460 None] Lock "b'cinder-990c281c-4627-4178-a1f4-29f0afc27310-delete_volume'" released by "delete_volume" :: held 7.024s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:50:49.424886 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-071f8268-dd83-4878-8c2c-f87868193c63 req-18b24924-f039-40ea-a41f-1cff9ac4770f tempest-TestVolumeBootPattern-406823548 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:50:49.613832 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-071f8268-dd83-4878-8c2c-f87868193c63 req-18b24924-f039-40ea-a41f-1cff9ac4770f tempest-TestVolumeBootPattern-406823548 None] deleting parent snapshot volume-9c3200c8-66a8-41af-bf6f-4afaf390d46e.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:50:51.697067 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b8a909db-d2e8-4bd2-8add-7e847ac96d95 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:51.828243 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [req-071f8268-dd83-4878-8c2c-f87868193c63 req-18b24924-f039-40ea-a41f-1cff9ac4770f tempest-TestVolumeBootPattern-406823548 None] Created reservations ['4ec33d40-6518-470c-afb5-80896a670cc8', '9818e565-8d1f-415d-b85a-26d6066823ad', 'ecfe91be-1dc7-4b91-bd7c-a3d70628dfec', '21b1befa-8f4b-4617-b1b8-0f10d629cf1e'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:50:52.052726 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-071f8268-dd83-4878-8c2c-f87868193c63 req-18b24924-f039-40ea-a41f-1cff9ac4770f tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:52.084685 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-071f8268-dd83-4878-8c2c-f87868193c63 req-18b24924-f039-40ea-a41f-1cff9ac4770f tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:52.115008 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [req-071f8268-dd83-4878-8c2c-f87868193c63 req-18b24924-f039-40ea-a41f-1cff9ac4770f tempest-TestVolumeBootPattern-406823548 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:50:52.118895 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-071f8268-dd83-4878-8c2c-f87868193c63 req-18b24924-f039-40ea-a41f-1cff9ac4770f tempest-TestVolumeBootPattern-406823548 None] Deleted volume successfully. May 02 10:50:52.181997 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-071f8268-dd83-4878-8c2c-f87868193c63 req-18b24924-f039-40ea-a41f-1cff9ac4770f tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-9c3200c8-66a8-41af-bf6f-4afaf390d46e-delete_volume'" released by "delete_volume" :: held 9.570s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:50:54.035621 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b8a909db-d2e8-4bd2-8add-7e847ac96d95 tempest-VolumesSnapshotTestJSON-616137826 None] Create snapshot completed successfully May 02 10:50:54.986545 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:50:55.017258 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Flow 'volume_create_manager' (9ad40c6e-fbef-4816-afc4-edc315ead425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:50:55.043246 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabceecf-6370-45fc-adfa-4103803dcae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:55.043812 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabceecf-6370-45fc-adfa-4103803dcae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1616067273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ca999e0f-a696-4f65-8844-9bbfc0a1de82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4b90de50a4ee8892e878b05fe2560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:50:55Z,use_quota=True,user_id='1f9a1244912e4296bde7c3a714e39bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:55.045111 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f425c1-37cc-4cc5-a457-249a478663ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:55.049244 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f425c1-37cc-4cc5-a457-249a478663ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:55.054367 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5072ad-219f-46e2-a2b2-6edddb850ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:55.058926 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5072ad-219f-46e2-a2b2-6edddb850ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca999e0f-a696-4f65-8844-9bbfc0a1de82', 'volume_name': 'volume-ca999e0f-a696-4f65-8844-9bbfc0a1de82', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:55.063873 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc5e5c8-552b-4224-abb0-62c1093b9a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:55.067777 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc5e5c8-552b-4224-abb0-62c1093b9a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:55.073261 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b884b0a-d9ed-4e1a-aa0c-570a820916c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:55.074335 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Volume ca999e0f-a696-4f65-8844-9bbfc0a1de82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca999e0f-a696-4f65-8844-9bbfc0a1de82', 'volume_size': 1} May 02 10:50:55.074743 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] creating volume 'volume-ca999e0f-a696-4f65-8844-9bbfc0a1de82' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:50:55.075529 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:55.150903 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-d05cd61b-ea7c-4024-be8d-023f59424dcf tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-26fc3207-9877-49b9-a747-ea88353cc9fa-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:50:55.152506 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d05cd61b-ea7c-4024-be8d-023f59424dcf tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:55.522517 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:50:55.542329 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Flow 'volume_create_manager' (7992f9d8-aa5c-43de-a001-00d3f22155b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:50:55.549021 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b690b402-c8f0-42c7-849d-91ac4efcff60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:55.564538 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b690b402-c8f0-42c7-849d-91ac4efcff60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-139244007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=106fa296-9289-4a5b-ad87-8677fe177974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014235b8daef456e97692382aac97d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:50:55Z,use_quota=True,user_id='1ca6e4cc7551419a9c5104419cd4b015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:55.569987 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76bad02e-e22e-42a7-a2dd-63f901fea000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:55.574781 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76bad02e-e22e-42a7-a2dd-63f901fea000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:55.579947 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62de3c96-5166-4447-bef4-0c7bdcf3adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:55.583982 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62de3c96-5166-4447-bef4-0c7bdcf3adac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106fa296-9289-4a5b-ad87-8677fe177974', 'volume_name': 'volume-106fa296-9289-4a5b-ad87-8677fe177974', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:55.590080 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14269bd-8636-4c75-a055-3d2400614930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:55.594326 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14269bd-8636-4c75-a055-3d2400614930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:55.599137 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244a29fc-4ee2-443e-b2c4-6aa9a4c1c007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:55.600162 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Volume 106fa296-9289-4a5b-ad87-8677fe177974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106fa296-9289-4a5b-ad87-8677fe177974', 'volume_size': 1} May 02 10:50:55.600548 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] creating volume 'volume-106fa296-9289-4a5b-ad87-8677fe177974' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:50:55.601236 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:56.072395 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:50:56.078619 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:50:56.078619 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b884b0a-d9ed-4e1a-aa0c-570a820916c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca999e0f-a696-4f65-8844-9bbfc0a1de82', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:56.081270 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e102983b-e7af-40c6-9002-2b5009439f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:56.161036 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Volume volume-ca999e0f-a696-4f65-8844-9bbfc0a1de82 (ca999e0f-a696-4f65-8844-9bbfc0a1de82): created successfully May 02 10:50:56.164983 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e102983b-e7af-40c6-9002-2b5009439f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:56.170746 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Flow 'volume_create_manager' (9ad40c6e-fbef-4816-afc4-edc315ead425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:50:56.229663 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-dec1e88f-6ca6-4794-ab21-077424438c6c tempest-VolumesServicesTestJSON-1910563300 None] Created volume successfully. May 02 10:50:56.495456 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:50:56.495865 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:50:56.499676 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244a29fc-4ee2-443e-b2c4-6aa9a4c1c007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106fa296-9289-4a5b-ad87-8677fe177974', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:56.504380 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0ec878-7f24-4365-a540-764e09af7e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:56.704323 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Volume volume-106fa296-9289-4a5b-ad87-8677fe177974 (106fa296-9289-4a5b-ad87-8677fe177974): created successfully May 02 10:50:56.708158 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0ec878-7f24-4365-a540-764e09af7e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:56.714414 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Flow 'volume_create_manager' (7992f9d8-aa5c-43de-a001-00d3f22155b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:50:56.811012 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-96c72560-3fc9-4066-b457-fa5e61db6f58 tempest-AttachVolumeShelveTestJSON-1117806735 None] Created volume successfully. May 02 10:50:57.322173 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-8afcfdca-4c8d-4041-a972-5f75963b33b2 tempest-VolumesServicesTestJSON-1910563300 None] Lock "b'cinder-ca999e0f-a696-4f65-8844-9bbfc0a1de82-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:50:57.444530 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8afcfdca-4c8d-4041-a972-5f75963b33b2 tempest-VolumesServicesTestJSON-1910563300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:57.561012 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8afcfdca-4c8d-4041-a972-5f75963b33b2 tempest-VolumesServicesTestJSON-1910563300 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:50:57.561381 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8afcfdca-4c8d-4041-a972-5f75963b33b2 tempest-VolumesServicesTestJSON-1910563300 None] Volume volume-ca999e0f-a696-4f65-8844-9bbfc0a1de82 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:50:57.675034 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8afcfdca-4c8d-4041-a972-5f75963b33b2 tempest-VolumesServicesTestJSON-1910563300 None] deleting rbd volume volume-ca999e0f-a696-4f65-8844-9bbfc0a1de82 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:50:58.208127 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:50:58.227188 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Flow 'volume_create_manager' (a0d5c795-9483-4d63-b33f-8b44e23252ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:50:58.233920 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502369d7-8212-4412-a57d-5690b9e05b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:58.249997 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502369d7-8212-4412-a57d-5690b9e05b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1944182716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a92939abc5401d88f4cdc0f1b109f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:50:58Z,use_quota=True,user_id='bad5953b4fbf4fe2a30a2b4208714631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:58.255368 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af56dee9-7e40-4f66-b63c-b4f5212882a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:58.260403 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af56dee9-7e40-4f66-b63c-b4f5212882a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:58.265497 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34218cc4-18d1-4481-948a-99af210f413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:58.347327 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34218cc4-18d1-4481-948a-99af210f413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37', 'volume_name': 'volume-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:58.352416 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32de201-2fc0-4dac-ae0a-eba4d023e976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:58.356317 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32de201-2fc0-4dac-ae0a-eba4d023e976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:50:58.361254 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188ce6ad-adbf-4e1d-b216-e57651b2eb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:50:58.362352 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Volume 9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:50:58.362922 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Cloning 9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37 from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:50:58.371521 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:50:58.469651 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 50, 58, 375413)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:50:58.472644 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:50:58.472644 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:50:58.475022 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.104s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:50:58.476218 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:50:58.482416 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 50, 58, 480136)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:50:58.482858 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:50:58.483250 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:50:58.495252 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:50:58.652394 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] creating snapshot='volume-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:51:00.441725 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37.clone_snap' to 'volume-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:51:00.799987 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:51:00.800645 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:00.828863 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:00.856342 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:51:02.172302 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:51:02.173488 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:51:02.173877 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:51:02.753324 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:51:02.753954 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Marking volume 9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37 as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:51:02.812817 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:51:02.813260 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Creating volume glance metadata for volume 9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37 backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:51:02.853956 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-8afcfdca-4c8d-4041-a972-5f75963b33b2 tempest-VolumesServicesTestJSON-1910563300 None] Created reservations ['d11b39af-aa84-4eb8-9d70-312fba364656', '4c959567-aeda-4c3c-bd98-7afa1a5f67cb', 'f1f1ca2b-5a5f-4430-9dfe-f1de044ff5e9', '3b611125-e412-4554-9996-6d9e10235141'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:51:02.965252 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188ce6ad-adbf-4e1d-b216-e57651b2eb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:02.969980 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01c6f75-e388-40d3-8a3c-0134cd4eb8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:03.001873 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8afcfdca-4c8d-4041-a972-5f75963b33b2 tempest-VolumesServicesTestJSON-1910563300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:03.023669 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8afcfdca-4c8d-4041-a972-5f75963b33b2 tempest-VolumesServicesTestJSON-1910563300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:03.046728 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-8afcfdca-4c8d-4041-a972-5f75963b33b2 tempest-VolumesServicesTestJSON-1910563300 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:51:03.051739 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-8afcfdca-4c8d-4041-a972-5f75963b33b2 tempest-VolumesServicesTestJSON-1910563300 None] Deleted volume successfully. May 02 10:51:03.055906 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Volume volume-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37 (9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37): created successfully May 02 10:51:03.060280 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01c6f75-e388-40d3-8a3c-0134cd4eb8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:03.066049 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Flow 'volume_create_manager' (a0d5c795-9483-4d63-b33f-8b44e23252ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:51:03.141390 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-8afcfdca-4c8d-4041-a972-5f75963b33b2 tempest-VolumesServicesTestJSON-1910563300 None] Lock "b'cinder-ca999e0f-a696-4f65-8844-9bbfc0a1de82-delete_volume'" released by "delete_volume" :: held 5.819s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:51:03.166745 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-58ca43d5-f249-40ac-95a0-0c81a01a712b tempest-TestVolumeBootPattern-406823548 None] Created volume successfully. May 02 10:51:07.024816 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-a73c63f3-8cce-4c6f-8971-389686ad67d7 req-d23cc5fd-5a77-48d0-bc01-feba6bbd1a75 tempest-TestVolumeBootPattern-406823548 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:51:07.693113 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-a73c63f3-8cce-4c6f-8971-389686ad67d7 req-d23cc5fd-5a77-48d0-bc01-feba6bbd1a75 tempest-TestVolumeBootPattern-406823548 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.668s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:51:07.694386 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-a73c63f3-8cce-4c6f-8971-389686ad67d7 req-d23cc5fd-5a77-48d0-bc01-feba6bbd1a75 tempest-TestVolumeBootPattern-406823548 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:51:07.808457 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-a73c63f3-8cce-4c6f-8971-389686ad67d7 req-d23cc5fd-5a77-48d0-bc01-feba6bbd1a75 tempest-TestVolumeBootPattern-406823548 None] Connection info returned from driver {'name': 'volumes/volume-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '536e917c-c3f8-4030-9431-5c6ce4150de5'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:51:07.928516 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-a73c63f3-8cce-4c6f-8971-389686ad67d7 req-d23cc5fd-5a77-48d0-bc01-feba6bbd1a75 tempest-TestVolumeBootPattern-406823548 None] attachment_update completed successfully. May 02 10:51:09.072349 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:51:09.093909 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Flow 'volume_create_manager' (dcdc8b30-7b38-4e24-a8ce-220edff3c438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:51:09.102847 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ebec90-c847-4885-bdde-d787193bdd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:09.118891 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ebec90-c847-4885-bdde-d787193bdd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-363281367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7d5aa92d-2942-4c89-966a-993e73135983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fea13f6873b4ef88f4246a75da8b129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:51:09Z,use_quota=True,user_id='2b76a9becbd24965af1841b23f7a6908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:09.124332 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858878ea-5b79-4fbb-bfc7-58aba439059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:09.128457 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858878ea-5b79-4fbb-bfc7-58aba439059b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:09.133974 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f907e3-5a8c-4d2b-85a4-758a25782913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:09.138578 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f907e3-5a8c-4d2b-85a4-758a25782913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5aa92d-2942-4c89-966a-993e73135983', 'volume_name': 'volume-7d5aa92d-2942-4c89-966a-993e73135983', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:09.143516 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26f77b0-bc08-46b2-af25-9cc95ea3dabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:09.147446 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26f77b0-bc08-46b2-af25-9cc95ea3dabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:09.152920 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a4c403-7d74-42cd-b836-a06d3cef8357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:09.153990 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Volume 7d5aa92d-2942-4c89-966a-993e73135983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5aa92d-2942-4c89-966a-993e73135983', 'volume_size': 1} May 02 10:51:09.154391 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] creating volume 'volume-7d5aa92d-2942-4c89-966a-993e73135983' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:51:09.155417 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:09.616082 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:51:09.616501 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:51:09.621166 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a4c403-7d74-42cd-b836-a06d3cef8357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5aa92d-2942-4c89-966a-993e73135983', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:09.625907 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0f145a-1885-406d-8d4e-43dc9a4ab9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:09.726354 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Volume volume-7d5aa92d-2942-4c89-966a-993e73135983 (7d5aa92d-2942-4c89-966a-993e73135983): created successfully May 02 10:51:09.730640 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0f145a-1885-406d-8d4e-43dc9a4ab9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:09.736649 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Flow 'volume_create_manager' (dcdc8b30-7b38-4e24-a8ce-220edff3c438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:51:09.818646 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-def42afc-e846-4604-95ad-26d3c0452729 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Created volume successfully. May 02 10:51:10.453174 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d5b7078-08b7-4d53-999d-0d133a67d490 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:11.854067 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4d5b7078-08b7-4d53-999d-0d133a67d490 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Create snapshot completed successfully May 02 10:51:13.202578 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-064e9e4e-d7dc-494b-8547-9d8706681803 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Lock "b'cinder-2dd7d49d-76cf-4406-a157-f32e0c113343-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:51:13.204104 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-064e9e4e-d7dc-494b-8547-9d8706681803 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:15.458196 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-064e9e4e-d7dc-494b-8547-9d8706681803 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Created reservations ['c8174dde-5839-47fb-9b6b-b8c132e243a8', '90431c74-98d3-4ba1-a58e-6b3600d46052', '64914764-33a0-420c-b9e0-72396e4cfab9', '10d8ee1f-12d1-4f17-95b8-3dbeb7675a3c'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:51:15.915737 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-064e9e4e-d7dc-494b-8547-9d8706681803 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Delete snapshot completed successfully. May 02 10:51:15.921891 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-064e9e4e-d7dc-494b-8547-9d8706681803 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Lock "b'cinder-2dd7d49d-76cf-4406-a157-f32e0c113343-delete_snapshot'" released by "delete_snapshot" :: held 2.719s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:51:16.539292 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-3ebd4b20-bc1d-4cb5-bb9d-210aae57fb10 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Lock "b'cinder-7d5aa92d-2942-4c89-966a-993e73135983-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:51:16.638342 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3ebd4b20-bc1d-4cb5-bb9d-210aae57fb10 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:16.784966 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3ebd4b20-bc1d-4cb5-bb9d-210aae57fb10 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:51:16.785381 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3ebd4b20-bc1d-4cb5-bb9d-210aae57fb10 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Volume volume-7d5aa92d-2942-4c89-966a-993e73135983 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:51:16.876316 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3ebd4b20-bc1d-4cb5-bb9d-210aae57fb10 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] deleting rbd volume volume-7d5aa92d-2942-4c89-966a-993e73135983 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:51:20.402237 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-3ebd4b20-bc1d-4cb5-bb9d-210aae57fb10 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Created reservations ['9c8daf82-3129-45da-a72b-492bdc9ec76a', '7cf8f05e-bc4f-45db-8d6a-4456ddc5c1b1', 'dae9dda3-81ef-4d0e-81e8-40373eaba308', 'ee198aef-4921-4a6b-99c7-9e76229be5d0'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:51:20.567892 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3ebd4b20-bc1d-4cb5-bb9d-210aae57fb10 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:20.602470 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3ebd4b20-bc1d-4cb5-bb9d-210aae57fb10 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:20.654640 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-3ebd4b20-bc1d-4cb5-bb9d-210aae57fb10 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:51:20.665977 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3ebd4b20-bc1d-4cb5-bb9d-210aae57fb10 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Deleted volume successfully. May 02 10:51:20.731076 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-3ebd4b20-bc1d-4cb5-bb9d-210aae57fb10 tempest-VolumeSnapshotQuotasNegativeTestJSON-973427342 None] Lock "b'cinder-7d5aa92d-2942-4c89-966a-993e73135983-delete_volume'" released by "delete_volume" :: held 4.192s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:51:26.498958 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-d05cd61b-ea7c-4024-be8d-023f59424dcf tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['8c5f0bf8-7fca-47fc-aa7b-68ea319a5ce5', 'a0c8eee2-3345-4e29-a8ae-3cfbfcbc6dd4', '07e48c63-a68e-41f4-912e-9717f7dbcb3e', 'eedb8075-e81f-4a06-aceb-6f3b0c7c26d3'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:51:26.677385 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:51:26.700520 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Flow 'volume_create_manager' (cedc23ee-5f8a-40ae-a699-a918238c17e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:51:26.707412 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5227d065-e8e3-42be-85c0-cb62c07598c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:26.710911 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-d05cd61b-ea7c-4024-be8d-023f59424dcf tempest-VolumesSnapshotTestJSON-616137826 None] Delete snapshot completed successfully. May 02 10:51:26.722724 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-d05cd61b-ea7c-4024-be8d-023f59424dcf tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-26fc3207-9877-49b9-a747-ea88353cc9fa-delete_snapshot'" released by "delete_snapshot" :: held 31.572s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:51:26.729056 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5227d065-e8e3-42be-85c0-cb62c07598c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1090558386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d12d006a-e3e5-424d-b4d4-5836d1700b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2eac51a96c4377a9837675807d0bbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:51:27Z,use_quota=True,user_id='456241eca666492ca5b25dfd2fb53769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:26.735613 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f835df-b4f7-4fcb-af69-5d5e2e1fd7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:26.739989 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f835df-b4f7-4fcb-af69-5d5e2e1fd7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:26.745345 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee438bf-1cd3-4b01-9618-118d0d4fbce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:26.749710 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee438bf-1cd3-4b01-9618-118d0d4fbce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd12d006a-e3e5-424d-b4d4-5836d1700b51', 'volume_name': 'volume-d12d006a-e3e5-424d-b4d4-5836d1700b51', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:26.754711 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7ae639-0de9-41e6-9772-3b62b25264eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:26.758882 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7ae639-0de9-41e6-9772-3b62b25264eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:26.763637 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0968c2c9-2b38-4fe8-aaa9-c5e92aa56345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:26.764759 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Volume d12d006a-e3e5-424d-b4d4-5836d1700b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d12d006a-e3e5-424d-b4d4-5836d1700b51', 'volume_size': 1} May 02 10:51:26.765117 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] creating volume 'volume-d12d006a-e3e5-424d-b4d4-5836d1700b51' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:51:26.766134 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:27.277429 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-b3cf4645-c0ca-4091-a724-82afd1a86a00 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-a7a5e3db-9121-496f-a0f1-4f814cc27ede-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:51:27.280326 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b3cf4645-c0ca-4091-a724-82afd1a86a00 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:27.519545 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:51:27.520147 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:51:27.523996 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0968c2c9-2b38-4fe8-aaa9-c5e92aa56345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d12d006a-e3e5-424d-b4d4-5836d1700b51', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:27.529070 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55770956-3a4a-45ed-87e2-c022a1a63ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:27.612706 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Volume volume-d12d006a-e3e5-424d-b4d4-5836d1700b51 (d12d006a-e3e5-424d-b4d4-5836d1700b51): created successfully May 02 10:51:27.616882 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55770956-3a4a-45ed-87e2-c022a1a63ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:27.650026 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Flow 'volume_create_manager' (cedc23ee-5f8a-40ae-a699-a918238c17e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:51:27.739718 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-61c49dac-1f47-4968-9e45-1b8445ed9412 tempest-VolumesBackupsAdminTest-292168352 None] Created volume successfully. May 02 10:51:29.470472 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b6b3eb7d-d5cc-4117-a577-611766c00562 tempest-VolumesBackupsAdminTest-292168352 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-02T10:51:28Z,data_timestamp=2022-05-02T10:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1081081643',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=5d54b583-3ca9-4e90-aa1f-0b0ffb591de2,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='ed2eac51a96c4377a9837675807d0bbd',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='456241eca666492ca5b25dfd2fb53769',volume_id=d12d006a-e3e5-424d-b4d4-5836d1700b51) May 02 10:51:29.471940 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.backup.rpcapi [None req-b6b3eb7d-d5cc-4117-a577-611766c00562 tempest-VolumesBackupsAdminTest-292168352 None] continue_backup in rpcapi backup_id 5d54b583-3ca9-4e90-aa1f-0b0ffb591de2 {{(pid=123784) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 02 10:51:29.599839 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-b6b3eb7d-d5cc-4117-a577-611766c00562 tempest-VolumesBackupsAdminTest-292168352 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:51:30.303847 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-b6b3eb7d-d5cc-4117-a577-611766c00562 tempest-VolumesBackupsAdminTest-292168352 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.704s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:51:30.304978 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b6b3eb7d-d5cc-4117-a577-611766c00562 tempest-VolumesBackupsAdminTest-292168352 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d12d006a-e3e5-424d-b4d4-5836d1700b51', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'd12d006a-e3e5-424d-b4d4-5836d1700b51', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:51:30.321939 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b6b3eb7d-d5cc-4117-a577-611766c00562 tempest-VolumesBackupsAdminTest-292168352 None] Initialize volume connection completed successfully. May 02 10:51:30.749147 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-d03bcd50-ddbd-48db-9ee0-cd3f2c64d4ac req-18450ad8-2cdd-4abf-992d-49bffdad308a tempest-AttachVolumeShelveTestJSON-1117806735 None] No connector for attachment 22482460-294d-4bd9-b921-01bc823a503c; skipping storage backend terminate_connection call. {{(pid=123784) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4910}} May 02 10:51:30.749747 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-d03bcd50-ddbd-48db-9ee0-cd3f2c64d4ac req-18450ad8-2cdd-4abf-992d-49bffdad308a tempest-AttachVolumeShelveTestJSON-1117806735 None] Deleting attachment 22482460-294d-4bd9-b921-01bc823a503c. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:51:35.823949 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b6b3eb7d-d5cc-4117-a577-611766c00562 tempest-VolumesBackupsAdminTest-292168352 None] Terminate volume connection completed successfully. May 02 10:51:35.841131 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b6b3eb7d-d5cc-4117-a577-611766c00562 tempest-VolumesBackupsAdminTest-292168352 None] Remove volume export completed successfully. May 02 10:51:39.283410 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:51:39.305478 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Flow 'volume_create_manager' (e78c7a05-3b56-4958-a67d-d60efafb0366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:51:39.312594 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33489481-75c9-4a17-af3d-f0ea85b4d838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:39.329223 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33489481-75c9-4a17-af3d-f0ea85b4d838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:51:39Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_5d54b583-3ca9-4e90-aa1f-0b0ffb591de2',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ee79e3e6-c565-4dfd-8225-fa966d6fde80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2eac51a96c4377a9837675807d0bbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:51:39Z,use_quota=True,user_id='456241eca666492ca5b25dfd2fb53769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:39.335416 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35fd2d6b-3132-4e19-b769-9d2f17408dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:39.340579 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35fd2d6b-3132-4e19-b769-9d2f17408dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:39.346058 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c62f11-7141-43a6-b966-951a308b3e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:39.350410 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c62f11-7141-43a6-b966-951a308b3e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee79e3e6-c565-4dfd-8225-fa966d6fde80', 'volume_name': 'volume-ee79e3e6-c565-4dfd-8225-fa966d6fde80', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:39.356585 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961e0082-29d3-4e18-8dbb-f36ff4366832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:39.360737 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961e0082-29d3-4e18-8dbb-f36ff4366832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:39.366184 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954efb64-68e5-4e58-bd3c-8256f9f28ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:39.366985 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Volume ee79e3e6-c565-4dfd-8225-fa966d6fde80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee79e3e6-c565-4dfd-8225-fa966d6fde80', 'volume_size': 1} May 02 10:51:39.367265 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] creating volume 'volume-ee79e3e6-c565-4dfd-8225-fa966d6fde80' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:51:39.368468 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:39.959896 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:51:39.960279 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:51:39.964470 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954efb64-68e5-4e58-bd3c-8256f9f28ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee79e3e6-c565-4dfd-8225-fa966d6fde80', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:39.969476 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a738a03-b42d-4476-96ef-a1f7377ecbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:51:40.092786 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Volume volume-ee79e3e6-c565-4dfd-8225-fa966d6fde80 (ee79e3e6-c565-4dfd-8225-fa966d6fde80): created successfully May 02 10:51:40.097804 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a738a03-b42d-4476-96ef-a1f7377ecbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:51:40.104684 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Flow 'volume_create_manager' (e78c7a05-3b56-4958-a67d-d60efafb0366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:51:40.195905 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Created volume successfully. May 02 10:51:41.338056 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:51:42.042331 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.703s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:51:42.042953 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ee79e3e6-c565-4dfd-8225-fa966d6fde80', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'ee79e3e6-c565-4dfd-8225-fa966d6fde80', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:51:42.059018 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Initialize volume connection completed successfully. May 02 10:51:46.308223 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Terminate volume connection completed successfully. May 02 10:51:46.331333 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a5489022-c3f6-466b-8354-879ec52caf25 tempest-VolumesBackupsAdminTest-292168352 None] Remove volume export completed successfully. May 02 10:51:47.656988 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-ea662cb2-8953-4360-b323-633a3bc7ab2b tempest-VolumesBackupsAdminTest-292168352 None] Lock "b'cinder-ee79e3e6-c565-4dfd-8225-fa966d6fde80-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:51:47.757119 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ea662cb2-8953-4360-b323-633a3bc7ab2b tempest-VolumesBackupsAdminTest-292168352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:50.435319 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ea662cb2-8953-4360-b323-633a3bc7ab2b tempest-VolumesBackupsAdminTest-292168352 None] Volume volume-ee79e3e6-c565-4dfd-8225-fa966d6fde80 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:51:51.299041 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ea662cb2-8953-4360-b323-633a3bc7ab2b tempest-VolumesBackupsAdminTest-292168352 None] deleting rbd volume volume-ee79e3e6-c565-4dfd-8225-fa966d6fde80 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:51:57.670015 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-ea662cb2-8953-4360-b323-633a3bc7ab2b tempest-VolumesBackupsAdminTest-292168352 None] Created reservations ['2d8f2ae8-fe17-4a22-8f96-7578c25f8b2d', 'fa5101a3-3733-4872-b1be-aa5bff03e7d9', 'd55b0c2e-2d25-4e9f-b754-8f02841f5861', '94b6a455-77eb-4ed3-a633-629a19762e56'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:51:57.819189 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ea662cb2-8953-4360-b323-633a3bc7ab2b tempest-VolumesBackupsAdminTest-292168352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:58.006243 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ea662cb2-8953-4360-b323-633a3bc7ab2b tempest-VolumesBackupsAdminTest-292168352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:51:58.031748 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-ea662cb2-8953-4360-b323-633a3bc7ab2b tempest-VolumesBackupsAdminTest-292168352 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:51:58.036225 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-ea662cb2-8953-4360-b323-633a3bc7ab2b tempest-VolumesBackupsAdminTest-292168352 None] Deleted volume successfully. May 02 10:51:58.109478 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-ea662cb2-8953-4360-b323-633a3bc7ab2b tempest-VolumesBackupsAdminTest-292168352 None] Lock "b'cinder-ee79e3e6-c565-4dfd-8225-fa966d6fde80-delete_volume'" released by "delete_volume" :: held 10.453s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:51:58.670461 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-b3cf4645-c0ca-4091-a724-82afd1a86a00 tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['8192bcf5-e9bf-4e8a-9468-b0d193da53bc', '55e52b39-8155-4ba5-adea-dd86fa5577f5', '4e9b671b-7771-40ca-91e4-778ee1c77993', '3fad153b-92a3-4956-b7aa-5f8bde65de22'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:51:58.824332 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b3cf4645-c0ca-4091-a724-82afd1a86a00 tempest-VolumesSnapshotTestJSON-616137826 None] Delete snapshot completed successfully. May 02 10:51:58.828829 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-b3cf4645-c0ca-4091-a724-82afd1a86a00 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-a7a5e3db-9121-496f-a0f1-4f814cc27ede-delete_snapshot'" released by "delete_snapshot" :: held 31.551s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:51:59.414478 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-c3bca3c8-a9bf-4a17-9d5a-240b93eadc78 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-825b8967-c0ef-4816-81b6-1480a4e327a2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:51:59.416875 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c3bca3c8-a9bf-4a17-9d5a-240b93eadc78 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:00.801497 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:52:00.802737 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:00.828872 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:00.854493 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:52:01.117505 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:52:01.140297 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Flow 'volume_create_manager' (ec3bee1f-d53d-49f3-ba3a-9987fcd6b5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:01.146882 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2031f992-2401-47b3-90ad-4dfb8fecfe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:01.161725 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2031f992-2401-47b3-90ad-4dfb8fecfe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-24856308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=28f5a82a-c70e-428b-b9af-7197fc3d359e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2eac51a96c4377a9837675807d0bbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:52:01Z,use_quota=True,user_id='456241eca666492ca5b25dfd2fb53769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:01.167150 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5056e48-0a04-4858-ae0c-99caaf430d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:01.171300 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5056e48-0a04-4858-ae0c-99caaf430d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:01.176451 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d05fb04-41f0-427a-9128-6cc0a4fcdbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:01.180655 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d05fb04-41f0-427a-9128-6cc0a4fcdbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f5a82a-c70e-428b-b9af-7197fc3d359e', 'volume_name': 'volume-28f5a82a-c70e-428b-b9af-7197fc3d359e', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:01.186046 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a325eb0-cae5-4365-8398-c6905bb9efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:01.189992 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a325eb0-cae5-4365-8398-c6905bb9efe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:01.194779 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2252eb18-3f4c-4465-bc3b-6997a2e9a5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:01.195851 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Volume 28f5a82a-c70e-428b-b9af-7197fc3d359e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f5a82a-c70e-428b-b9af-7197fc3d359e', 'volume_size': 1} May 02 10:52:01.196248 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] creating volume 'volume-28f5a82a-c70e-428b-b9af-7197fc3d359e' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:52:01.197067 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:01.981232 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:52:01.981806 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:52:01.986210 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2252eb18-3f4c-4465-bc3b-6997a2e9a5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f5a82a-c70e-428b-b9af-7197fc3d359e', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:01.990967 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74030938-f0e8-49f1-8925-f2d674a2502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:02.052497 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Volume volume-28f5a82a-c70e-428b-b9af-7197fc3d359e (28f5a82a-c70e-428b-b9af-7197fc3d359e): created successfully May 02 10:52:02.056261 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74030938-f0e8-49f1-8925-f2d674a2502b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:02.061883 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Flow 'volume_create_manager' (ec3bee1f-d53d-49f3-ba3a-9987fcd6b5c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:02.115187 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-03b061ea-eccc-463d-b94e-01a3ce033810 tempest-VolumesBackupsAdminTest-292168352 None] Created volume successfully. May 02 10:52:03.510039 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e9381b61-0c84-44b3-b9ad-6b31494a5797 tempest-VolumesBackupsAdminTest-292168352 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-02T10:52:03Z,data_timestamp=2022-05-02T10:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1031484434',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=810bb01c-a183-4044-a1ec-52099d05b1c1,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='ed2eac51a96c4377a9837675807d0bbd',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='456241eca666492ca5b25dfd2fb53769',volume_id=28f5a82a-c70e-428b-b9af-7197fc3d359e) May 02 10:52:03.510873 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.backup.rpcapi [None req-e9381b61-0c84-44b3-b9ad-6b31494a5797 tempest-VolumesBackupsAdminTest-292168352 None] continue_backup in rpcapi backup_id 810bb01c-a183-4044-a1ec-52099d05b1c1 {{(pid=123784) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 02 10:52:03.621973 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-e9381b61-0c84-44b3-b9ad-6b31494a5797 tempest-VolumesBackupsAdminTest-292168352 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:52:04.244361 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-e9381b61-0c84-44b3-b9ad-6b31494a5797 tempest-VolumesBackupsAdminTest-292168352 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.622s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:52:04.245415 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e9381b61-0c84-44b3-b9ad-6b31494a5797 tempest-VolumesBackupsAdminTest-292168352 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-28f5a82a-c70e-428b-b9af-7197fc3d359e', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '28f5a82a-c70e-428b-b9af-7197fc3d359e', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:52:04.260961 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e9381b61-0c84-44b3-b9ad-6b31494a5797 tempest-VolumesBackupsAdminTest-292168352 None] Initialize volume connection completed successfully. May 02 10:52:11.619090 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e9381b61-0c84-44b3-b9ad-6b31494a5797 tempest-VolumesBackupsAdminTest-292168352 None] Terminate volume connection completed successfully. May 02 10:52:11.636695 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e9381b61-0c84-44b3-b9ad-6b31494a5797 tempest-VolumesBackupsAdminTest-292168352 None] Remove volume export completed successfully. May 02 10:52:22.366928 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-2ddba27f-2256-4303-86ab-a1f81237dbc6 tempest-VolumesBackupsAdminTest-292168352 None] Lock "b'cinder-28f5a82a-c70e-428b-b9af-7197fc3d359e-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:52:22.443295 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2ddba27f-2256-4303-86ab-a1f81237dbc6 tempest-VolumesBackupsAdminTest-292168352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:24.903356 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2ddba27f-2256-4303-86ab-a1f81237dbc6 tempest-VolumesBackupsAdminTest-292168352 None] Volume volume-28f5a82a-c70e-428b-b9af-7197fc3d359e is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:52:25.539134 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2ddba27f-2256-4303-86ab-a1f81237dbc6 tempest-VolumesBackupsAdminTest-292168352 None] deleting rbd volume volume-28f5a82a-c70e-428b-b9af-7197fc3d359e {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:52:27.905549 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-1ecf4d01-13c4-4933-a842-fe00677befe1 tempest-AttachVolumeShelveTestJSON-1117806735 None] Lock "b'cinder-106fa296-9289-4a5b-ad87-8677fe177974-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:52:28.008112 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ecf4d01-13c4-4933-a842-fe00677befe1 tempest-AttachVolumeShelveTestJSON-1117806735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:28.326879 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ecf4d01-13c4-4933-a842-fe00677befe1 tempest-AttachVolumeShelveTestJSON-1117806735 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:52:28.327311 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ecf4d01-13c4-4933-a842-fe00677befe1 tempest-AttachVolumeShelveTestJSON-1117806735 None] Volume volume-106fa296-9289-4a5b-ad87-8677fe177974 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:52:28.476152 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ecf4d01-13c4-4933-a842-fe00677befe1 tempest-AttachVolumeShelveTestJSON-1117806735 None] deleting rbd volume volume-106fa296-9289-4a5b-ad87-8677fe177974 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:52:30.681184 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-c3bca3c8-a9bf-4a17-9d5a-240b93eadc78 tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['19fde237-1021-4449-960a-9e07bae00648', 'ad96250c-a004-4077-9f0a-b62814e08f50', 'da146e5b-cafc-4cf4-825c-41ea47efc301', 'd769e957-2b52-47eb-abc2-ce7c5e7c8141'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:52:30.824433 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-c3bca3c8-a9bf-4a17-9d5a-240b93eadc78 tempest-VolumesSnapshotTestJSON-616137826 None] Delete snapshot completed successfully. May 02 10:52:30.828910 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-c3bca3c8-a9bf-4a17-9d5a-240b93eadc78 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-825b8967-c0ef-4816-81b6-1480a4e327a2-delete_snapshot'" released by "delete_snapshot" :: held 31.415s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:52:31.786064 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:52:31.807129 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Flow 'volume_create_manager' (9d73f8f3-1172-4cd0-81da-42a172638a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:31.814489 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a5e7cf-11fa-4730-801d-77b64f7819f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:31.836818 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a5e7cf-11fa-4730-801d-77b64f7819f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-628822685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2257323c692e4608b9a5468b7aa57846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:52:32Z,use_quota=True,user_id='bb25448d45ac488797f59e828cafdb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:31.842521 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90665d0f-47e0-4572-9152-a586a6df5602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:31.846769 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90665d0f-47e0-4572-9152-a586a6df5602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:31.852036 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88447c2a-a49a-44e9-92e7-76bee4584bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:31.856379 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88447c2a-a49a-44e9-92e7-76bee4584bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206', 'volume_name': 'volume-0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:31.861403 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398d2a81-96dc-405c-afd9-b1a7b6adf37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:31.865896 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398d2a81-96dc-405c-afd9-b1a7b6adf37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:31.870727 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b44053e-c0be-4098-bd34-619e8bbc8eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:31.871820 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Volume 0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206', 'volume_size': 1} May 02 10:52:31.872248 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] creating volume 'volume-0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:52:31.873298 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:32.041292 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-2ddba27f-2256-4303-86ab-a1f81237dbc6 tempest-VolumesBackupsAdminTest-292168352 None] Created reservations ['3001456a-6ae6-4c23-b336-dcdd65533233', 'c30b8b70-8bdb-4a50-992e-4d2b36e56f03', 'de2f6fc6-fcfe-4f2e-9e93-29cde9bbf4f6', '91cd9562-d25a-4f42-85c6-f5a85148d25a'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:52:32.259481 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2ddba27f-2256-4303-86ab-a1f81237dbc6 tempest-VolumesBackupsAdminTest-292168352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:32.347778 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2ddba27f-2256-4303-86ab-a1f81237dbc6 tempest-VolumesBackupsAdminTest-292168352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:32.371439 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-2ddba27f-2256-4303-86ab-a1f81237dbc6 tempest-VolumesBackupsAdminTest-292168352 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:52:32.376752 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2ddba27f-2256-4303-86ab-a1f81237dbc6 tempest-VolumesBackupsAdminTest-292168352 None] Deleted volume successfully. May 02 10:52:32.394858 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-8e77924f-217b-48c5-a699-b373ee3dc38b req-76b71144-0b01-492a-bfff-b516097204d7 tempest-VolumesSnapshotTestJSON-616137826 None] Terminate volume connection completed successfully. May 02 10:52:32.395273 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-8e77924f-217b-48c5-a699-b373ee3dc38b req-76b71144-0b01-492a-bfff-b516097204d7 tempest-VolumesSnapshotTestJSON-616137826 None] Deleting attachment fbdb6dd2-1102-436b-a5de-01ae1938005b. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:52:32.485970 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-2ddba27f-2256-4303-86ab-a1f81237dbc6 tempest-VolumesBackupsAdminTest-292168352 None] Lock "b'cinder-28f5a82a-c70e-428b-b9af-7197fc3d359e-delete_volume'" released by "delete_volume" :: held 10.119s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:52:32.930111 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:52:32.930844 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:52:32.934294 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b44053e-c0be-4098-bd34-619e8bbc8eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:32.939624 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e76ac4-b083-44da-91dd-f11a01744968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:32.991101 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Volume volume-0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206 (0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206): created successfully May 02 10:52:32.995117 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e76ac4-b083-44da-91dd-f11a01744968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:33.003267 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Flow 'volume_create_manager' (9d73f8f3-1172-4cd0-81da-42a172638a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:33.070853 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b082be9d-b579-4658-a98e-3fa1b6024e20 tempest-AttachVolumeTestJSON-2054785600 None] Created volume successfully. May 02 10:52:33.082485 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-e6c2bb84-dd17-40e4-b275-9876dc77147e tempest-VolumesBackupsAdminTest-292168352 None] Lock "b'cinder-d12d006a-e3e5-424d-b4d4-5836d1700b51-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:52:33.173578 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e6c2bb84-dd17-40e4-b275-9876dc77147e tempest-VolumesBackupsAdminTest-292168352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:35.422966 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e6c2bb84-dd17-40e4-b275-9876dc77147e tempest-VolumesBackupsAdminTest-292168352 None] Volume volume-d12d006a-e3e5-424d-b4d4-5836d1700b51 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:52:36.139250 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e6c2bb84-dd17-40e4-b275-9876dc77147e tempest-VolumesBackupsAdminTest-292168352 None] deleting rbd volume volume-d12d006a-e3e5-424d-b4d4-5836d1700b51 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:52:36.169732 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-0ec42249-2dd8-4d12-8619-f696bd6c0d30 req-966f1697-ef81-46e8-bb22-1a3436499e65 tempest-AttachVolumeTestJSON-2054785600 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:52:36.272003 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-1ecf4d01-13c4-4933-a842-fe00677befe1 tempest-AttachVolumeShelveTestJSON-1117806735 None] Created reservations ['0fd32c20-9d9b-434e-8fd5-aed282c8a52b', '69629163-1de4-43e1-b327-e618ae025987', '8bfbfc2e-ca4d-416d-a895-ddf520318a33', 'f8b1c60a-3ac1-4942-b21b-44312ab505c5'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:52:36.465180 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ecf4d01-13c4-4933-a842-fe00677befe1 tempest-AttachVolumeShelveTestJSON-1117806735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:36.502363 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ecf4d01-13c4-4933-a842-fe00677befe1 tempest-AttachVolumeShelveTestJSON-1117806735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:36.542020 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-1ecf4d01-13c4-4933-a842-fe00677befe1 tempest-AttachVolumeShelveTestJSON-1117806735 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:52:36.549685 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-1ecf4d01-13c4-4933-a842-fe00677befe1 tempest-AttachVolumeShelveTestJSON-1117806735 None] Deleted volume successfully. May 02 10:52:36.652355 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-1ecf4d01-13c4-4933-a842-fe00677befe1 tempest-AttachVolumeShelveTestJSON-1117806735 None] Lock "b'cinder-106fa296-9289-4a5b-ad87-8677fe177974-delete_volume'" released by "delete_volume" :: held 8.747s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:52:36.815551 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-0ec42249-2dd8-4d12-8619-f696bd6c0d30 req-966f1697-ef81-46e8-bb22-1a3436499e65 tempest-AttachVolumeTestJSON-2054785600 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.646s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:52:36.816203 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-0ec42249-2dd8-4d12-8619-f696bd6c0d30 req-966f1697-ef81-46e8-bb22-1a3436499e65 tempest-AttachVolumeTestJSON-2054785600 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:52:36.893290 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-0ec42249-2dd8-4d12-8619-f696bd6c0d30 req-966f1697-ef81-46e8-bb22-1a3436499e65 tempest-AttachVolumeTestJSON-2054785600 None] Connection info returned from driver {'name': 'volumes/volume-0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4c10fa13-7fcc-492a-8054-ed73cb06683c'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:52:37.058035 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-0ec42249-2dd8-4d12-8619-f696bd6c0d30 req-966f1697-ef81-46e8-bb22-1a3436499e65 tempest-AttachVolumeTestJSON-2054785600 None] attachment_update completed successfully. May 02 10:52:37.420303 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:52:37.440381 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Flow 'volume_create_manager' (76e32b85-20ef-42e6-a4e4-08a2934ba070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:37.447447 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3216dd8-c4da-48c9-87ef-bf6a4c6ce5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:37.462581 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3216dd8-c4da-48c9-87ef-bf6a4c6ce5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1032172373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6ee2536d-91ba-4320-971c-2695bf1ea071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23dc31c03ada4eba97ae47aab53487d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:52:37Z,use_quota=True,user_id='f58c631280fb4cdb917abc34660e3325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:37.468106 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7fafda-3d2d-4b02-a42c-556415915fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:37.472401 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7fafda-3d2d-4b02-a42c-556415915fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:37.478328 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7226e7-61eb-4579-89d4-7cf6dd73bde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:37.482902 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7226e7-61eb-4579-89d4-7cf6dd73bde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee2536d-91ba-4320-971c-2695bf1ea071', 'volume_name': 'volume-6ee2536d-91ba-4320-971c-2695bf1ea071', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:37.487962 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71264f3-bc27-41d9-929c-ad246cd3f3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:37.492653 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71264f3-bc27-41d9-929c-ad246cd3f3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:37.497284 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d06faf-f58c-483c-add0-2d36345cb530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:37.498368 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Volume 6ee2536d-91ba-4320-971c-2695bf1ea071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee2536d-91ba-4320-971c-2695bf1ea071', 'volume_size': 1} May 02 10:52:37.498777 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] creating volume 'volume-6ee2536d-91ba-4320-971c-2695bf1ea071' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:52:37.499580 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:37.608530 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-2b494e38-58e7-4b45-87a5-36e7e9b784e9 tempest-AttachVolumeShelveTestJSON-1117806735 None] Lock "b'cinder-ad2018ec-4624-4ab9-b6e3-f53d994111da-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:52:37.698378 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b494e38-58e7-4b45-87a5-36e7e9b784e9 tempest-AttachVolumeShelveTestJSON-1117806735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:37.812557 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b494e38-58e7-4b45-87a5-36e7e9b784e9 tempest-AttachVolumeShelveTestJSON-1117806735 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:52:37.812973 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b494e38-58e7-4b45-87a5-36e7e9b784e9 tempest-AttachVolumeShelveTestJSON-1117806735 None] Volume volume-ad2018ec-4624-4ab9-b6e3-f53d994111da is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:52:38.076044 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b494e38-58e7-4b45-87a5-36e7e9b784e9 tempest-AttachVolumeShelveTestJSON-1117806735 None] deleting rbd volume volume-ad2018ec-4624-4ab9-b6e3-f53d994111da {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:52:38.501134 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:52:38.501796 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:52:38.505334 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d06faf-f58c-483c-add0-2d36345cb530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee2536d-91ba-4320-971c-2695bf1ea071', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:38.510015 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba3d4a6-d322-47ce-ac3f-07bb59a512e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:38.578223 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Volume volume-6ee2536d-91ba-4320-971c-2695bf1ea071 (6ee2536d-91ba-4320-971c-2695bf1ea071): created successfully May 02 10:52:38.582268 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba3d4a6-d322-47ce-ac3f-07bb59a512e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:38.588485 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Flow 'volume_create_manager' (76e32b85-20ef-42e6-a4e4-08a2934ba070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:38.647285 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-ce59b79f-b020-4459-aaa6-56b681e663b0 tempest-VolumesSnapshotTestJSON-616137826 None] Created volume successfully. May 02 10:52:39.748121 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6c2fa758-2a24-48ea-a3de-a756cecf0ebd tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:40.591709 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:52:40.613067 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Flow 'volume_create_manager' (6f8a6b37-3840-42f2-bccc-06b6d7fb7db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:40.620230 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f36209-d823-4fa4-bffa-1ff0301cb6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:40.635236 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f36209-d823-4fa4-bffa-1ff0301cb6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2076821681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2257323c692e4608b9a5468b7aa57846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:52:40Z,use_quota=True,user_id='bb25448d45ac488797f59e828cafdb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:40.640989 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af77e50-01c6-42d9-a45a-e373543b5170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:40.645209 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af77e50-01c6-42d9-a45a-e373543b5170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:40.650432 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16444727-b37a-4254-ac57-fe88b491045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:40.654626 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16444727-b37a-4254-ac57-fe88b491045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd', 'volume_name': 'volume-efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:40.659653 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1934534-88a2-41b8-80b6-1ad8907a6c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:40.664148 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1934534-88a2-41b8-80b6-1ad8907a6c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:40.668962 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4343f13e-fa7f-4fe9-add4-2d107d6834f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:40.670031 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Volume efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd', 'volume_size': 1} May 02 10:52:40.670430 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] creating volume 'volume-efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:52:40.671094 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:41.655246 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:52:41.655809 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:52:41.659542 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4343f13e-fa7f-4fe9-add4-2d107d6834f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:41.664420 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f3a23e-e57e-4537-ad8e-186130d57e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:41.749620 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Volume volume-efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd (efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd): created successfully May 02 10:52:41.753163 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f3a23e-e57e-4537-ad8e-186130d57e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:41.759246 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Flow 'volume_create_manager' (6f8a6b37-3840-42f2-bccc-06b6d7fb7db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:41.835688 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2de8be40-ba70-410d-8f99-80c5daf0b189 tempest-AttachVolumeTestJSON-2054785600 None] Created volume successfully. May 02 10:52:42.859610 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-6c2fa758-2a24-48ea-a3de-a756cecf0ebd tempest-VolumesSnapshotTestJSON-616137826 None] Create snapshot completed successfully May 02 10:52:43.341000 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-afd5b6da-19f2-42cb-9cc9-f3df6fb78657 req-aecf0537-cfb7-4991-9176-468d9f40ec36 tempest-AttachVolumeTestJSON-2054785600 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:52:43.447707 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-e6c2bb84-dd17-40e4-b275-9876dc77147e tempest-VolumesBackupsAdminTest-292168352 None] Created reservations ['cef45fd8-2d60-4588-96b7-414d321837cd', 'db8bdda2-ac87-4b6d-9378-eab744923286', '61761284-93f0-41c1-9db8-5e316121095e', 'b7c5221a-0255-4632-895d-b531c3f1d7e8'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:52:43.680967 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e6c2bb84-dd17-40e4-b275-9876dc77147e tempest-VolumesBackupsAdminTest-292168352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:43.718737 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e6c2bb84-dd17-40e4-b275-9876dc77147e tempest-VolumesBackupsAdminTest-292168352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:43.762789 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-e6c2bb84-dd17-40e4-b275-9876dc77147e tempest-VolumesBackupsAdminTest-292168352 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:52:43.767515 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e6c2bb84-dd17-40e4-b275-9876dc77147e tempest-VolumesBackupsAdminTest-292168352 None] Deleted volume successfully. May 02 10:52:43.866592 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-e6c2bb84-dd17-40e4-b275-9876dc77147e tempest-VolumesBackupsAdminTest-292168352 None] Lock "b'cinder-d12d006a-e3e5-424d-b4d4-5836d1700b51-delete_volume'" released by "delete_volume" :: held 10.784s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:52:43.997322 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-afd5b6da-19f2-42cb-9cc9-f3df6fb78657 req-aecf0537-cfb7-4991-9176-468d9f40ec36 tempest-AttachVolumeTestJSON-2054785600 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.656s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:52:44.000449 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-afd5b6da-19f2-42cb-9cc9-f3df6fb78657 req-aecf0537-cfb7-4991-9176-468d9f40ec36 tempest-AttachVolumeTestJSON-2054785600 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 10:52:44.110624 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-afd5b6da-19f2-42cb-9cc9-f3df6fb78657 req-aecf0537-cfb7-4991-9176-468d9f40ec36 tempest-AttachVolumeTestJSON-2054785600 None] Connection info returned from driver {'name': 'volumes/volume-efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c26b9431-9a92-45a4-bd6b-e1bc4a37c75a'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 10:52:44.258704 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-afd5b6da-19f2-42cb-9cc9-f3df6fb78657 req-aecf0537-cfb7-4991-9176-468d9f40ec36 tempest-AttachVolumeTestJSON-2054785600 None] attachment_update completed successfully. May 02 10:52:44.626768 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:52:44.655796 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Flow 'volume_create_manager' (8e83e1e6-0f74-4a44-85ab-076278a67af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:44.663229 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60676088-f93b-498b-ac34-4397c94bf380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:44.685235 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60676088-f93b-498b-ac34-4397c94bf380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1267068963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=034085e8-5c93-4f79-b260-23950bd231ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23dc31c03ada4eba97ae47aab53487d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:52:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=be607bc2-a2fb-44f1-a3ee-998e33b7ceca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:52:44Z,use_quota=True,user_id='f58c631280fb4cdb917abc34660e3325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:44.690741 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca2e076-711a-4427-a3c0-00e374b9cbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:44.694900 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca2e076-711a-4427-a3c0-00e374b9cbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:44.700719 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5740f0e7-450f-4547-9c10-464721fc9917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:44.704788 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5740f0e7-450f-4547-9c10-464721fc9917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '034085e8-5c93-4f79-b260-23950bd231ea', 'volume_name': 'volume-034085e8-5c93-4f79-b260-23950bd231ea', 'volume_size': 2, 'snapshot_id': 'be607bc2-a2fb-44f1-a3ee-998e33b7ceca'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:44.709822 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c8c413-5b77-40b6-8d38-a9a24d0d50f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:44.713991 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c8c413-5b77-40b6-8d38-a9a24d0d50f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:44.718859 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40de2d4e-4532-41fa-8020-7fdc9c920981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:44.719948 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Volume 034085e8-5c93-4f79-b260-23950bd231ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-034085e8-5c93-4f79-b260-23950bd231ea', 'volume_size': 2, 'snapshot_id': 'be607bc2-a2fb-44f1-a3ee-998e33b7ceca'} May 02 10:52:44.743696 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] cloning volumes/volume-6ee2536d-91ba-4320-971c-2695bf1ea071@snapshot-be607bc2-a2fb-44f1-a3ee-998e33b7ceca to volume-034085e8-5c93-4f79-b260-23950bd231ea {{(pid=123784) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 02 10:52:44.744367 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:44.813037 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:45.070574 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-2b494e38-58e7-4b45-87a5-36e7e9b784e9 tempest-AttachVolumeShelveTestJSON-1117806735 None] Created reservations ['818f39a5-d94c-4a54-b1f1-4dff9223721e', '3cb71b89-7efc-4d73-8eaa-fc527422a947', 'c86e0c66-db26-41ee-a303-ad1f12cd6e0b', '061a784a-3386-4f70-beeb-2245be7a272a'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:52:45.213925 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b494e38-58e7-4b45-87a5-36e7e9b784e9 tempest-AttachVolumeShelveTestJSON-1117806735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:45.235247 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b494e38-58e7-4b45-87a5-36e7e9b784e9 tempest-AttachVolumeShelveTestJSON-1117806735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:45.257911 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-2b494e38-58e7-4b45-87a5-36e7e9b784e9 tempest-AttachVolumeShelveTestJSON-1117806735 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:52:45.262174 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2b494e38-58e7-4b45-87a5-36e7e9b784e9 tempest-AttachVolumeShelveTestJSON-1117806735 None] Deleted volume successfully. May 02 10:52:45.384067 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-2b494e38-58e7-4b45-87a5-36e7e9b784e9 tempest-AttachVolumeShelveTestJSON-1117806735 None] Lock "b'cinder-ad2018ec-4624-4ab9-b6e3-f53d994111da-delete_volume'" released by "delete_volume" :: held 7.773s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:52:46.856990 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:52:46.856990 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:52:46.870447 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:48.024371 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-ac2ea1e1-5014-4f34-9440-513df52c3a55 req-6b718056-035f-4a01-b26d-bfdc8daa21c2 tempest-AttachVolumeTestJSON-2054785600 None] Terminate volume connection completed successfully. May 02 10:52:48.025128 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-ac2ea1e1-5014-4f34-9440-513df52c3a55 req-6b718056-035f-4a01-b26d-bfdc8daa21c2 tempest-AttachVolumeTestJSON-2054785600 None] Deleting attachment 4c10fa13-7fcc-492a-8054-ed73cb06683c. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:52:48.214917 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:52:48.235176 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Flow 'volume_create_manager' (57926734-be40-466d-9c33-09a372b75883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:48.245571 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfdda22-491f-4451-a677-269ab473bf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:48.257307 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfdda22-491f-4451-a677-269ab473bf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1780525135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=98211b08-9e53-48ce-ab4e-53c37a0640eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2161f6c2a9c042f291228503be66aeb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:52:48Z,use_quota=True,user_id='64dc59860b5a4156b666c5307a43c925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:48.263045 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5af3bb-0f7b-41ed-8a82-0da3a42d37fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:48.268732 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5af3bb-0f7b-41ed-8a82-0da3a42d37fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:48.272358 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e65e58-82a9-406f-9fac-486b5cc3db86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:48.373740 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e65e58-82a9-406f-9fac-486b5cc3db86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98211b08-9e53-48ce-ab4e-53c37a0640eb', 'volume_name': 'volume-98211b08-9e53-48ce-ab4e-53c37a0640eb', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:48.385264 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81217c0d-3665-4ea5-a23c-e6891d046bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:48.393704 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81217c0d-3665-4ea5-a23c-e6891d046bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:48.399383 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c1bbe2-8d1b-4c6c-a675-4efbf6e44d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:48.401460 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Volume 98211b08-9e53-48ce-ab4e-53c37a0640eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98211b08-9e53-48ce-ab4e-53c37a0640eb', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:52:48.402178 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Cloning 98211b08-9e53-48ce-ab4e-53c37a0640eb from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:52:48.412836 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:52:48.470087 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 52, 48, 416520)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:52:48.470985 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:52:48.471484 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:52:48.476203 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.064s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:52:48.481812 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:52:48.484437 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 52, 48, 481717)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:52:48.484899 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:52:48.485299 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:52:48.496918 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:48.801672 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] creating snapshot='volume-98211b08-9e53-48ce-ab4e-53c37a0640eb.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:52:50.899074 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-98211b08-9e53-48ce-ab4e-53c37a0640eb.clone_snap' to 'volume-98211b08-9e53-48ce-ab4e-53c37a0640eb' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:52:50.934551 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40de2d4e-4532-41fa-8020-7fdc9c920981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034085e8-5c93-4f79-b260-23950bd231ea', 'volume_size': 2, 'snapshot_id': 'be607bc2-a2fb-44f1-a3ee-998e33b7ceca'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:50.939626 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedd003a-813a-4139-b207-c932b662e6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:50.951279 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-7ba5e1e3-4948-411f-abb9-184e58f74e88 req-33568b04-d91a-41a1-a55a-b83bd66bf544 tempest-AttachVolumeTestJSON-2054785600 None] Terminate volume connection completed successfully. May 02 10:52:50.951279 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-7ba5e1e3-4948-411f-abb9-184e58f74e88 req-33568b04-d91a-41a1-a55a-b83bd66bf544 tempest-AttachVolumeTestJSON-2054785600 None] Deleting attachment c26b9431-9a92-45a4-bd6b-e1bc4a37c75a. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:52:51.019359 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Volume volume-034085e8-5c93-4f79-b260-23950bd231ea (034085e8-5c93-4f79-b260-23950bd231ea): created successfully May 02 10:52:51.023370 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedd003a-813a-4139-b207-c932b662e6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:51.033841 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Flow 'volume_create_manager' (8e83e1e6-0f74-4a44-85ab-076278a67af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:51.121436 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f347f456-6d8c-40c1-926b-e5b2ac42c833 tempest-VolumesSnapshotTestJSON-616137826 None] Created volume successfully. May 02 10:52:52.109566 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-97e2efd5-d703-4c9d-a4d8-adaef6f170de tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-034085e8-5c93-4f79-b260-23950bd231ea-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:52:52.224932 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-97e2efd5-d703-4c9d-a4d8-adaef6f170de tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:52.521613 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-97e2efd5-d703-4c9d-a4d8-adaef6f170de tempest-VolumesSnapshotTestJSON-616137826 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:52:52.711096 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-97e2efd5-d703-4c9d-a4d8-adaef6f170de tempest-VolumesSnapshotTestJSON-616137826 None] deleting rbd volume volume-034085e8-5c93-4f79-b260-23950bd231ea {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:52:53.063400 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:52:53.064470 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:52:53.064883 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:52:53.880063 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:52:53.880713 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Marking volume 98211b08-9e53-48ce-ab4e-53c37a0640eb as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:52:53.956076 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 98211b08-9e53-48ce-ab4e-53c37a0640eb. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:52:53.956516 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Creating volume glance metadata for volume 98211b08-9e53-48ce-ab4e-53c37a0640eb backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:52:54.059319 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c1bbe2-8d1b-4c6c-a675-4efbf6e44d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98211b08-9e53-48ce-ab4e-53c37a0640eb', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:54.064906 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d4a7a1-13b6-47e6-99b1-16eb9acdc71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:54.121500 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Volume volume-98211b08-9e53-48ce-ab4e-53c37a0640eb (98211b08-9e53-48ce-ab4e-53c37a0640eb): created successfully May 02 10:52:54.125459 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d4a7a1-13b6-47e6-99b1-16eb9acdc71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:54.131310 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Flow 'volume_create_manager' (57926734-be40-466d-9c33-09a372b75883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:54.208523 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-44e81548-723d-4a95-8090-0c4d8c1527cf tempest-VolumesCloneTest-280710931 None] Created volume successfully. May 02 10:52:55.077962 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:52:55.108071 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Flow 'volume_create_manager' (c1193853-a42a-4d9f-8b4a-82868bdc6e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:52:55.116429 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c868d1-dd3e-4a9e-a404-9de9732b6678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:55.133885 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c868d1-dd3e-4a9e-a404-9de9732b6678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-902413284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1fef83d-6082-4d58-8fe3-ca30674bf9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2161f6c2a9c042f291228503be66aeb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=98211b08-9e53-48ce-ab4e-53c37a0640eb,status='creating',terminated_at=None,updated_at=2022-05-02T10:52:55Z,use_quota=True,user_id='64dc59860b5a4156b666c5307a43c925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:55.139748 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354ca28d-ac86-435f-865d-1ce01a21d701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:55.144517 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354ca28d-ac86-435f-865d-1ce01a21d701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:55.150643 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755babb5-42d4-4fad-a948-55eec04fc8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:55.167109 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755babb5-42d4-4fad-a948-55eec04fc8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c1fef83d-6082-4d58-8fe3-ca30674bf9c2', 'volume_name': 'volume-c1fef83d-6082-4d58-8fe3-ca30674bf9c2', 'volume_size': 1, 'source_volid': '98211b08-9e53-48ce-ab4e-53c37a0640eb', 'source_volstatus': 'available'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:55.172441 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f78f922-ed47-477b-ad59-e751dc1eec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:55.179022 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f78f922-ed47-477b-ad59-e751dc1eec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:52:55.184833 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6567a95b-57d9-4863-8f70-735a5ebdd6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:52:55.185930 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Volume c1fef83d-6082-4d58-8fe3-ca30674bf9c2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c1fef83d-6082-4d58-8fe3-ca30674bf9c2', 'volume_size': 1, 'source_volid': '98211b08-9e53-48ce-ab4e-53c37a0640eb', 'source_volstatus': 'available'} May 02 10:52:55.200463 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:55.459150 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] creating snapshot='volume-c1fef83d-6082-4d58-8fe3-ca30674bf9c2.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:52:57.716472 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] cloning 'volume-98211b08-9e53-48ce-ab4e-53c37a0640eb@volume-c1fef83d-6082-4d58-8fe3-ca30674bf9c2.clone_snap' to 'volume-c1fef83d-6082-4d58-8fe3-ca30674bf9c2' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:52:57.729990 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-da097d66-663b-4bbb-a292-a6f208c03c85 tempest-AttachVolumeTestJSON-2054785600 None] Lock "b'cinder-efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:52:57.802027 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-da097d66-663b-4bbb-a292-a6f208c03c85 tempest-AttachVolumeTestJSON-2054785600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:58.092491 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-da097d66-663b-4bbb-a292-a6f208c03c85 tempest-AttachVolumeTestJSON-2054785600 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:52:58.092961 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-da097d66-663b-4bbb-a292-a6f208c03c85 tempest-AttachVolumeTestJSON-2054785600 None] Volume volume-efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:52:58.270658 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-da097d66-663b-4bbb-a292-a6f208c03c85 tempest-AttachVolumeTestJSON-2054785600 None] deleting rbd volume volume-efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:52:59.395882 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-97e2efd5-d703-4c9d-a4d8-adaef6f170de tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['97c97ed2-9989-4695-bcd0-517faa429eb6', 'a1d155f4-0791-4e25-b9de-e22c2c64ca2d', '1bab2cdb-cb83-4fc6-9c93-0bff415aab71', 'a264486c-b6b6-4604-9643-46a2750b1ea1'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:52:59.590643 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-97e2efd5-d703-4c9d-a4d8-adaef6f170de tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:59.629851 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-97e2efd5-d703-4c9d-a4d8-adaef6f170de tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:52:59.654702 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-97e2efd5-d703-4c9d-a4d8-adaef6f170de tempest-VolumesSnapshotTestJSON-616137826 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:52:59.659719 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-97e2efd5-d703-4c9d-a4d8-adaef6f170de tempest-VolumesSnapshotTestJSON-616137826 None] Deleted volume successfully. May 02 10:52:59.749877 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:52:59.751341 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:52:59.751728 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:53:00.494288 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:53:00.495166 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Marking volume c1fef83d-6082-4d58-8fe3-ca30674bf9c2 as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:53:00.520297 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-97e2efd5-d703-4c9d-a4d8-adaef6f170de tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-034085e8-5c93-4f79-b260-23950bd231ea-delete_volume'" released by "delete_volume" :: held 8.410s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:00.557202 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Copying metadata from source volume 98211b08-9e53-48ce-ab4e-53c37a0640eb to c1fef83d-6082-4d58-8fe3-ca30674bf9c2. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:436}} May 02 10:53:00.580761 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:53:00.600057 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Flow 'volume_create_manager' (75b0239b-2886-4b59-a1d8-1e20ac48a023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:53:00.607020 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f986443a-7c10-4349-99aa-860150f88fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:00.624236 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f986443a-7c10-4349-99aa-860150f88fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1900163684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1816d0e3-90a0-487a-8c89-5800874dd95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23dc31c03ada4eba97ae47aab53487d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:53:00Z,use_quota=True,user_id='f58c631280fb4cdb917abc34660e3325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:00.629712 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412b01cd-d4e2-452e-9f17-75c2efe5086d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:00.633874 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412b01cd-d4e2-452e-9f17-75c2efe5086d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:00.639407 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e821c762-21c0-4fa5-bb7a-f59742376e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:00.643526 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e821c762-21c0-4fa5-bb7a-f59742376e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1816d0e3-90a0-487a-8c89-5800874dd95e', 'volume_name': 'volume-1816d0e3-90a0-487a-8c89-5800874dd95e', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:00.648489 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f456fd44-887a-4ac2-b5b9-7bb12d2ac237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:00.652479 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f456fd44-887a-4ac2-b5b9-7bb12d2ac237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:00.657462 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3b4bf8-8620-4f44-8ea0-ffb9a7f595f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:00.658523 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Volume 1816d0e3-90a0-487a-8c89-5800874dd95e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1816d0e3-90a0-487a-8c89-5800874dd95e', 'volume_size': 1} May 02 10:53:00.658913 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] creating volume 'volume-1816d0e3-90a0-487a-8c89-5800874dd95e' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:53:00.659688 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:00.685688 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6567a95b-57d9-4863-8f70-735a5ebdd6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fef83d-6082-4d58-8fe3-ca30674bf9c2', 'volume_size': 1, 'source_volid': '98211b08-9e53-48ce-ab4e-53c37a0640eb', 'source_volstatus': 'available'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:00.691936 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca781ed9-24c1-461b-a295-65c0deb99e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:00.755698 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Volume volume-c1fef83d-6082-4d58-8fe3-ca30674bf9c2 (c1fef83d-6082-4d58-8fe3-ca30674bf9c2): created successfully May 02 10:53:00.759431 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca781ed9-24c1-461b-a295-65c0deb99e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:00.765322 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Flow 'volume_create_manager' (c1193853-a42a-4d9f-8b4a-82868bdc6e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:53:00.800960 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:53:00.801711 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:00.825296 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:00.848104 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:53:00.854082 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f26b8aac-0189-4d0a-ab73-c494336b2e5d tempest-VolumesCloneTest-280710931 None] Created volume successfully. May 02 10:53:01.634650 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:53:01.635276 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:53:01.639450 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3b4bf8-8620-4f44-8ea0-ffb9a7f595f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1816d0e3-90a0-487a-8c89-5800874dd95e', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:01.644214 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ef5207-073e-4ab1-8cd1-85f1684ed93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:01.699790 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Volume volume-1816d0e3-90a0-487a-8c89-5800874dd95e (1816d0e3-90a0-487a-8c89-5800874dd95e): created successfully May 02 10:53:01.703825 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ef5207-073e-4ab1-8cd1-85f1684ed93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:01.710001 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Flow 'volume_create_manager' (75b0239b-2886-4b59-a1d8-1e20ac48a023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:53:01.784314 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f026dd62-bbb7-446e-a85c-f84373f43742 tempest-VolumesSnapshotTestJSON-616137826 None] Created volume successfully. May 02 10:53:02.024430 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:53:02.032641 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Flow 'volume_create_manager' (c615a2f8-1296-4fed-8c44-c9b216f7b413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:53:02.039826 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5129e8-ebc3-414e-805e-d71208139952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:02.056919 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5129e8-ebc3-414e-805e-d71208139952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-161520890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=95d761d2-7a33-4679-b33b-65dbfca86194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2161f6c2a9c042f291228503be66aeb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:53:02Z,use_quota=True,user_id='64dc59860b5a4156b666c5307a43c925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:02.062603 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849cbf20-bae2-4759-9fe9-4c8a799b1c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:02.066877 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849cbf20-bae2-4759-9fe9-4c8a799b1c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:02.072264 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead8720a-8d04-40bb-b891-9b3a502e4144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:02.076742 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead8720a-8d04-40bb-b891-9b3a502e4144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d761d2-7a33-4679-b33b-65dbfca86194', 'volume_name': 'volume-95d761d2-7a33-4679-b33b-65dbfca86194', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:02.081852 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96659450-d32c-427d-8604-6da06e6c858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:02.086346 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96659450-d32c-427d-8604-6da06e6c858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:02.091251 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72207a0-2314-4916-a5b8-3d41c5fae1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:02.092346 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Volume 95d761d2-7a33-4679-b33b-65dbfca86194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d761d2-7a33-4679-b33b-65dbfca86194', 'volume_size': 1} May 02 10:53:02.093289 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] creating volume 'volume-95d761d2-7a33-4679-b33b-65dbfca86194' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:53:02.093973 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:02.754765 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0d0a779d-9c26-4b99-8bad-4da4e8edacc3 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:03.017967 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:53:03.018327 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:53:03.022119 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72207a0-2314-4916-a5b8-3d41c5fae1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d761d2-7a33-4679-b33b-65dbfca86194', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:03.027500 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b9d5e2-d9e3-4c88-bdec-6b611b392b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:03.104260 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Volume volume-95d761d2-7a33-4679-b33b-65dbfca86194 (95d761d2-7a33-4679-b33b-65dbfca86194): created successfully May 02 10:53:03.108038 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b9d5e2-d9e3-4c88-bdec-6b611b392b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:03.113893 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Flow 'volume_create_manager' (c615a2f8-1296-4fed-8c44-c9b216f7b413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:53:03.201404 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-86e48628-8157-4fd4-b493-760cdab61004 tempest-VolumesCloneTest-280710931 None] Created volume successfully. May 02 10:53:04.809583 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:53:04.840553 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Flow 'volume_create_manager' (bc17200b-8a92-4a09-8c93-af52d1f29056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:53:04.845019 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe61e0a8-696f-4a5f-8ca1-f0b019f772ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:04.860251 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe61e0a8-696f-4a5f-8ca1-f0b019f772ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1682577917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2161f6c2a9c042f291228503be66aeb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:53:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=95d761d2-7a33-4679-b33b-65dbfca86194,status='creating',terminated_at=None,updated_at=2022-05-02T10:53:05Z,use_quota=True,user_id='64dc59860b5a4156b666c5307a43c925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:04.865744 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4870035c-a6e0-4c64-8961-de863389f45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:04.870429 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4870035c-a6e0-4c64-8961-de863389f45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:04.875608 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be380f34-c8e8-45d2-9a77-3131de22479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:04.891071 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be380f34-c8e8-45d2-9a77-3131de22479a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c', 'volume_name': 'volume-2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c', 'volume_size': 2, 'source_volid': '95d761d2-7a33-4679-b33b-65dbfca86194', 'source_volstatus': 'available'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:04.896082 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68ea47a-3bd2-499b-84ea-3c4e4694ae2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:04.900060 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68ea47a-3bd2-499b-84ea-3c4e4694ae2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:04.904945 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48399e0-c5ad-47a8-9b82-c2a87227ed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:04.906011 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Volume 2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c', 'volume_size': 2, 'source_volid': '95d761d2-7a33-4679-b33b-65dbfca86194', 'source_volstatus': 'available'} May 02 10:53:04.916261 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:05.252836 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] creating snapshot='volume-2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:53:07.088527 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] cloning 'volume-95d761d2-7a33-4679-b33b-65dbfca86194@volume-2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c.clone_snap' to 'volume-2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:53:07.201663 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-da097d66-663b-4bbb-a292-a6f208c03c85 tempest-AttachVolumeTestJSON-2054785600 None] Created reservations ['01e98267-817e-4566-91bb-0f45c7f608a8', '62984e3b-a4e8-47ec-ac98-0b0f1bfbc902', '1df1a1fa-ea27-45f8-8cf0-a074ef82a243', 'e01bdeee-5889-49bb-ab81-637a3c7d6699'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:53:07.487751 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-da097d66-663b-4bbb-a292-a6f208c03c85 tempest-AttachVolumeTestJSON-2054785600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:07.512798 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-da097d66-663b-4bbb-a292-a6f208c03c85 tempest-AttachVolumeTestJSON-2054785600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:07.541620 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-da097d66-663b-4bbb-a292-a6f208c03c85 tempest-AttachVolumeTestJSON-2054785600 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:53:07.545598 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-da097d66-663b-4bbb-a292-a6f208c03c85 tempest-AttachVolumeTestJSON-2054785600 None] Deleted volume successfully. May 02 10:53:07.611008 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-da097d66-663b-4bbb-a292-a6f208c03c85 tempest-AttachVolumeTestJSON-2054785600 None] Lock "b'cinder-efa85b43-58f9-4ab9-bbe2-96f4c3e84ccd-delete_volume'" released by "delete_volume" :: held 9.881s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:08.053427 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-14be7ea5-1350-4ffb-9031-be198c24ef9e tempest-AttachVolumeTestJSON-2054785600 None] Lock "b'cinder-0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:53:08.133333 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-14be7ea5-1350-4ffb-9031-be198c24ef9e tempest-AttachVolumeTestJSON-2054785600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:08.367287 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-14be7ea5-1350-4ffb-9031-be198c24ef9e tempest-AttachVolumeTestJSON-2054785600 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:53:08.367716 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-14be7ea5-1350-4ffb-9031-be198c24ef9e tempest-AttachVolumeTestJSON-2054785600 None] Volume volume-0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:53:08.556057 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-14be7ea5-1350-4ffb-9031-be198c24ef9e tempest-AttachVolumeTestJSON-2054785600 None] deleting rbd volume volume-0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:53:08.671200 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-0d0a779d-9c26-4b99-8bad-4da4e8edacc3 tempest-VolumesSnapshotTestJSON-616137826 None] Create snapshot completed successfully May 02 10:53:09.031206 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Volume volume-95d761d2-7a33-4679-b33b-65dbfca86194 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:53:09.033676 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:53:09.034368 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:53:09.596161 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] resize volume 'volume-2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c' from 1 to 2 {{(pid=123784) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:743}} May 02 10:53:09.597017 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:09.928515 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:53:09.956016 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Flow 'volume_create_manager' (2a4b3092-9dc7-4140-b9cd-056a3053c703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:53:09.962588 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c19659b-fa74-4af8-b1d2-4c623b1ca86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:09.978123 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c19659b-fa74-4af8-b1d2-4c623b1ca86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-373626035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b91d9a1-0403-47b6-8893-f812b3e707cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23dc31c03ada4eba97ae47aab53487d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2e462232-6f8f-4362-ab47-086787fcf1cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:53:09Z,use_quota=True,user_id='f58c631280fb4cdb917abc34660e3325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:09.984173 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84df86bb-9843-44d0-ae68-86a9e522b4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:09.988354 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84df86bb-9843-44d0-ae68-86a9e522b4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:09.993572 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788b7416-5325-441e-85a2-bf97a0847471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:09.997661 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788b7416-5325-441e-85a2-bf97a0847471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b91d9a1-0403-47b6-8893-f812b3e707cd', 'volume_name': 'volume-2b91d9a1-0403-47b6-8893-f812b3e707cd', 'volume_size': 1, 'snapshot_id': '2e462232-6f8f-4362-ab47-086787fcf1cd'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:10.002659 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210bec67-f4eb-464c-a328-32ecfa2a0836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:10.006642 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210bec67-f4eb-464c-a328-32ecfa2a0836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:10.011788 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d26c9b-b23a-4592-ab8c-da0f87e0a03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:10.012927 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Volume 2b91d9a1-0403-47b6-8893-f812b3e707cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b91d9a1-0403-47b6-8893-f812b3e707cd', 'volume_size': 1, 'snapshot_id': '2e462232-6f8f-4362-ab47-086787fcf1cd'} May 02 10:53:10.030654 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] cloning volumes/volume-1816d0e3-90a0-487a-8c89-5800874dd95e@snapshot-2e462232-6f8f-4362-ab47-086787fcf1cd to volume-2b91d9a1-0403-47b6-8893-f812b3e707cd {{(pid=123784) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 02 10:53:10.031324 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:10.067068 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:11.445950 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:53:11.451712 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48399e0-c5ad-47a8-9b82-c2a87227ed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c', 'volume_size': 2, 'source_volid': '95d761d2-7a33-4679-b33b-65dbfca86194', 'source_volstatus': 'available'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:11.454791 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f36214d-a6f6-4451-a5df-e4493a2f5e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:11.516043 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Volume volume-2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c (2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c): created successfully May 02 10:53:11.519959 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f36214d-a6f6-4451-a5df-e4493a2f5e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:11.525640 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Flow 'volume_create_manager' (bc17200b-8a92-4a09-8c93-af52d1f29056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:53:11.578803 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-26bac340-cd02-4c6d-b518-5d07031f278a tempest-VolumesCloneTest-280710931 None] Created volume successfully. May 02 10:53:11.834607 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:53:11.835220 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:53:11.863381 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d26c9b-b23a-4592-ab8c-da0f87e0a03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b91d9a1-0403-47b6-8893-f812b3e707cd', 'volume_size': 1, 'snapshot_id': '2e462232-6f8f-4362-ab47-086787fcf1cd'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:11.868345 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cead0910-1aac-48a2-b8b9-b1b89c1a502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:53:11.926880 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Volume volume-2b91d9a1-0403-47b6-8893-f812b3e707cd (2b91d9a1-0403-47b6-8893-f812b3e707cd): created successfully May 02 10:53:11.930692 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cead0910-1aac-48a2-b8b9-b1b89c1a502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:53:11.936720 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Flow 'volume_create_manager' (2a4b3092-9dc7-4140-b9cd-056a3053c703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:53:11.995687 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-8be325cd-6b4f-462d-ab0a-2dd87708df43 tempest-VolumesSnapshotTestJSON-616137826 None] Created volume successfully. May 02 10:53:12.109763 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] Lock "b'cinder-2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:53:12.195458 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:12.601965 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:53:12.969350 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] deleting rbd volume volume-2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:53:12.983786 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-8231fb01-5003-4b37-933c-22e8f18b2a55 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-2b91d9a1-0403-47b6-8893-f812b3e707cd-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:53:13.133624 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8231fb01-5003-4b37-933c-22e8f18b2a55 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:13.349965 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8231fb01-5003-4b37-933c-22e8f18b2a55 tempest-VolumesSnapshotTestJSON-616137826 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:53:13.585005 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8231fb01-5003-4b37-933c-22e8f18b2a55 tempest-VolumesSnapshotTestJSON-616137826 None] deleting rbd volume volume-2b91d9a1-0403-47b6-8893-f812b3e707cd {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:53:15.127184 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-14be7ea5-1350-4ffb-9031-be198c24ef9e tempest-AttachVolumeTestJSON-2054785600 None] Created reservations ['0dadd64e-9a82-46be-b821-61ac21237eea', '0e322e5f-a425-431f-be4b-76b48058b614', '361cb084-15e5-44a1-84fb-0170221fa2ce', '31b9d7b8-9fa4-4396-8cfb-6d2c03428806'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:53:15.360631 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-14be7ea5-1350-4ffb-9031-be198c24ef9e tempest-AttachVolumeTestJSON-2054785600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:15.383599 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-14be7ea5-1350-4ffb-9031-be198c24ef9e tempest-AttachVolumeTestJSON-2054785600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:15.421907 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-14be7ea5-1350-4ffb-9031-be198c24ef9e tempest-AttachVolumeTestJSON-2054785600 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:53:15.433524 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-14be7ea5-1350-4ffb-9031-be198c24ef9e tempest-AttachVolumeTestJSON-2054785600 None] Deleted volume successfully. May 02 10:53:15.486358 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-14be7ea5-1350-4ffb-9031-be198c24ef9e tempest-AttachVolumeTestJSON-2054785600 None] Lock "b'cinder-0b60c5ce-29b1-44f8-b4fa-b4efa3dd2206-delete_volume'" released by "delete_volume" :: held 7.433s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:15.806671 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-1083d060-5ffe-4eed-a04d-418914630e67 tempest-AttachVolumeTestJSON-2054785600 None] Lock "b'cinder-453a04f5-f8a1-4fc6-ba94-a74125e71e56-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:53:15.904944 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1083d060-5ffe-4eed-a04d-418914630e67 tempest-AttachVolumeTestJSON-2054785600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:16.144025 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1083d060-5ffe-4eed-a04d-418914630e67 tempest-AttachVolumeTestJSON-2054785600 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:53:16.144638 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1083d060-5ffe-4eed-a04d-418914630e67 tempest-AttachVolumeTestJSON-2054785600 None] Volume volume-453a04f5-f8a1-4fc6-ba94-a74125e71e56 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:53:16.402314 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1083d060-5ffe-4eed-a04d-418914630e67 tempest-AttachVolumeTestJSON-2054785600 None] deleting rbd volume volume-453a04f5-f8a1-4fc6-ba94-a74125e71e56 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:53:20.260186 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:53:20.465125 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] Volume volume-95d761d2-7a33-4679-b33b-65dbfca86194 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:53:20.466288 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] deleting parent snapshot volume-2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:53:23.562335 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-8231fb01-5003-4b37-933c-22e8f18b2a55 tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['a29cef4c-32ff-42e9-b70f-4c5b9d1a9405', '0a397aae-0123-43a9-91f4-f81b214869ea', 'd5765fca-e54f-4ea0-a2cb-2557b6d62de7', '64d06fc6-9492-4c97-9675-ac3ef7d05f92'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:53:23.565492 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] Created reservations ['12241c90-392a-431b-b197-6865d6854dca', '2baf3339-31fe-48f1-aba4-2d6bc8d3d790', '6da91b06-1703-4e6b-a4e5-010c12455f3f', '02f674ee-c4c5-4501-834a-eb9ea11bf15d'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:53:23.568101 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-1083d060-5ffe-4eed-a04d-418914630e67 tempest-AttachVolumeTestJSON-2054785600 None] Created reservations ['f7c2cfc2-d066-46a5-82fb-95cd3536a448', '198a7375-e4d4-486f-914b-2afee8bdad31', '290f6902-16fd-421b-b5dc-f0acc9a65b6f', 'bdb992fa-2501-4c61-9bb5-2fb19951f5df'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:53:23.928082 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1083d060-5ffe-4eed-a04d-418914630e67 tempest-AttachVolumeTestJSON-2054785600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:23.965308 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1083d060-5ffe-4eed-a04d-418914630e67 tempest-AttachVolumeTestJSON-2054785600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:24.008155 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-1083d060-5ffe-4eed-a04d-418914630e67 tempest-AttachVolumeTestJSON-2054785600 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:53:24.017710 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8231fb01-5003-4b37-933c-22e8f18b2a55 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:24.062055 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8231fb01-5003-4b37-933c-22e8f18b2a55 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:24.120815 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-8231fb01-5003-4b37-933c-22e8f18b2a55 tempest-VolumesSnapshotTestJSON-616137826 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:53:24.123946 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:24.170780 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:24.227607 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:53:24.233701 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-1083d060-5ffe-4eed-a04d-418914630e67 tempest-AttachVolumeTestJSON-2054785600 None] Deleted volume successfully. May 02 10:53:24.237569 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-8231fb01-5003-4b37-933c-22e8f18b2a55 tempest-VolumesSnapshotTestJSON-616137826 None] Deleted volume successfully. May 02 10:53:24.260430 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] Deleted volume successfully. May 02 10:53:24.333222 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-8231fb01-5003-4b37-933c-22e8f18b2a55 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-2b91d9a1-0403-47b6-8893-f812b3e707cd-delete_volume'" released by "delete_volume" :: held 11.349s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:24.356358 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-00eed4d4-3689-4014-8866-d4aef42318d7 tempest-VolumesCloneTest-280710931 None] Lock "b'cinder-2c5f7ef0-1c76-4ea3-b8e6-6c59ba90679c-delete_volume'" released by "delete_volume" :: held 12.246s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:24.359770 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-1083d060-5ffe-4eed-a04d-418914630e67 tempest-AttachVolumeTestJSON-2054785600 None] Lock "b'cinder-453a04f5-f8a1-4fc6-ba94-a74125e71e56-delete_volume'" released by "delete_volume" :: held 8.555s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:24.631048 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-8f44571e-0157-4fc4-8950-c0ac9d7f7011 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-2e462232-6f8f-4362-ab47-086787fcf1cd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:53:24.639479 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-8f44571e-0157-4fc4-8950-c0ac9d7f7011 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:24.971566 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-d8de4979-c60d-4e00-8c8d-8f201fa9cab2 tempest-VolumesCloneTest-280710931 None] Lock "b'cinder-95d761d2-7a33-4679-b33b-65dbfca86194-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:53:25.119296 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d8de4979-c60d-4e00-8c8d-8f201fa9cab2 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:25.458860 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d8de4979-c60d-4e00-8c8d-8f201fa9cab2 tempest-VolumesCloneTest-280710931 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:53:25.459712 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d8de4979-c60d-4e00-8c8d-8f201fa9cab2 tempest-VolumesCloneTest-280710931 None] Volume volume-95d761d2-7a33-4679-b33b-65dbfca86194 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:53:25.601551 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d8de4979-c60d-4e00-8c8d-8f201fa9cab2 tempest-VolumesCloneTest-280710931 None] deleting rbd volume volume-95d761d2-7a33-4679-b33b-65dbfca86194 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:53:29.242031 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-8f44571e-0157-4fc4-8950-c0ac9d7f7011 tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['d37c98fb-65ee-45ef-8d22-a9c6e1456564', '63cff812-75ea-43e6-9ada-b8cde788cfd6', 'baa0c160-a677-4be2-b5d8-eba29956a024', '27b8e768-3cff-46e5-bc73-001c1e45e4b1'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:53:29.401493 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-8f44571e-0157-4fc4-8950-c0ac9d7f7011 tempest-VolumesSnapshotTestJSON-616137826 None] Delete snapshot completed successfully. May 02 10:53:29.411409 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-8f44571e-0157-4fc4-8950-c0ac9d7f7011 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-2e462232-6f8f-4362-ab47-086787fcf1cd-delete_snapshot'" released by "delete_snapshot" :: held 4.781s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:30.045666 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-174b9268-a716-41d9-b1cc-911d57d3cf03 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-1816d0e3-90a0-487a-8c89-5800874dd95e-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:53:30.148427 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-174b9268-a716-41d9-b1cc-911d57d3cf03 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:30.374450 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-174b9268-a716-41d9-b1cc-911d57d3cf03 tempest-VolumesSnapshotTestJSON-616137826 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:53:30.375869 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-174b9268-a716-41d9-b1cc-911d57d3cf03 tempest-VolumesSnapshotTestJSON-616137826 None] Volume volume-1816d0e3-90a0-487a-8c89-5800874dd95e is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:53:30.527879 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-174b9268-a716-41d9-b1cc-911d57d3cf03 tempest-VolumesSnapshotTestJSON-616137826 None] deleting rbd volume volume-1816d0e3-90a0-487a-8c89-5800874dd95e {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:53:32.350830 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-d8de4979-c60d-4e00-8c8d-8f201fa9cab2 tempest-VolumesCloneTest-280710931 None] Created reservations ['cfd37239-68fc-43be-8b7b-3ca6e5105c3b', 'b6f66ee6-eef5-463d-a251-07370266a93a', 'ad350156-3462-42a3-a276-e9a6903ce8b0', '26473698-924b-4776-8ddc-795cad27208a'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:53:32.545476 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d8de4979-c60d-4e00-8c8d-8f201fa9cab2 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:32.581743 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d8de4979-c60d-4e00-8c8d-8f201fa9cab2 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:32.608734 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-d8de4979-c60d-4e00-8c8d-8f201fa9cab2 tempest-VolumesCloneTest-280710931 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:53:32.613356 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-d8de4979-c60d-4e00-8c8d-8f201fa9cab2 tempest-VolumesCloneTest-280710931 None] Deleted volume successfully. May 02 10:53:32.681831 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-96303f18-1e90-457f-a3fa-78094ee71f06 tempest-VolumesCloneTest-280710931 None] Lock "b'cinder-c1fef83d-6082-4d58-8fe3-ca30674bf9c2-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:53:32.711660 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-d8de4979-c60d-4e00-8c8d-8f201fa9cab2 tempest-VolumesCloneTest-280710931 None] Lock "b'cinder-95d761d2-7a33-4679-b33b-65dbfca86194-delete_volume'" released by "delete_volume" :: held 7.741s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:32.775023 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-96303f18-1e90-457f-a3fa-78094ee71f06 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:33.155930 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-96303f18-1e90-457f-a3fa-78094ee71f06 tempest-VolumesCloneTest-280710931 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:53:33.501719 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-96303f18-1e90-457f-a3fa-78094ee71f06 tempest-VolumesCloneTest-280710931 None] deleting rbd volume volume-c1fef83d-6082-4d58-8fe3-ca30674bf9c2 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:53:37.573206 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-174b9268-a716-41d9-b1cc-911d57d3cf03 tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['197dc848-52eb-49dc-8828-7a3807ec4a72', '16004126-d29e-4387-8005-c39f04eb8d7e', 'ca3e61a1-c832-46aa-a3f3-e46ecafec4b0', '5f01c162-ac94-4888-9fc9-3c10a487c933'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:53:37.734258 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-174b9268-a716-41d9-b1cc-911d57d3cf03 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:37.774423 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-174b9268-a716-41d9-b1cc-911d57d3cf03 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:37.802383 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-174b9268-a716-41d9-b1cc-911d57d3cf03 tempest-VolumesSnapshotTestJSON-616137826 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:53:37.806650 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-174b9268-a716-41d9-b1cc-911d57d3cf03 tempest-VolumesSnapshotTestJSON-616137826 None] Deleted volume successfully. May 02 10:53:37.882659 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-174b9268-a716-41d9-b1cc-911d57d3cf03 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-1816d0e3-90a0-487a-8c89-5800874dd95e-delete_volume'" released by "delete_volume" :: held 7.837s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:38.708883 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f75fbc36-7416-4178-ad78-be9b2ed19bf2 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-be607bc2-a2fb-44f1-a3ee-998e33b7ceca-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:53:38.708883 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f75fbc36-7416-4178-ad78-be9b2ed19bf2 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:40.573872 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-96303f18-1e90-457f-a3fa-78094ee71f06 tempest-VolumesCloneTest-280710931 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:53:40.861025 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-96303f18-1e90-457f-a3fa-78094ee71f06 tempest-VolumesCloneTest-280710931 None] deleting parent snapshot volume-c1fef83d-6082-4d58-8fe3-ca30674bf9c2.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:53:44.202225 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-96303f18-1e90-457f-a3fa-78094ee71f06 tempest-VolumesCloneTest-280710931 None] Created reservations ['a58759f9-11cf-450b-ab9b-7e6d589240c8', '5ed859ca-a0ca-4b1b-a646-92a7d2eca329', '6a110428-2b53-4dd6-84e4-2b3d76147632', '96bd8b55-3bd5-47e6-bc74-a50d1eee5c1e'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:53:44.374266 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-96303f18-1e90-457f-a3fa-78094ee71f06 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:44.414565 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-96303f18-1e90-457f-a3fa-78094ee71f06 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:44.452258 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-96303f18-1e90-457f-a3fa-78094ee71f06 tempest-VolumesCloneTest-280710931 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:53:44.457951 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-96303f18-1e90-457f-a3fa-78094ee71f06 tempest-VolumesCloneTest-280710931 None] Deleted volume successfully. May 02 10:53:44.567153 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-96303f18-1e90-457f-a3fa-78094ee71f06 tempest-VolumesCloneTest-280710931 None] Lock "b'cinder-c1fef83d-6082-4d58-8fe3-ca30674bf9c2-delete_volume'" released by "delete_volume" :: held 11.881s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:44.591925 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-4c958900-d48b-4f41-b3d9-243b4e3ade14 tempest-VolumesCloneTest-280710931 None] Lock "b'cinder-98211b08-9e53-48ce-ab4e-53c37a0640eb-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:53:44.684312 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4c958900-d48b-4f41-b3d9-243b4e3ade14 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:45.013187 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4c958900-d48b-4f41-b3d9-243b4e3ade14 tempest-VolumesCloneTest-280710931 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:53:45.096686 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4c958900-d48b-4f41-b3d9-243b4e3ade14 tempest-VolumesCloneTest-280710931 None] deleting rbd volume volume-98211b08-9e53-48ce-ab4e-53c37a0640eb {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:53:45.167952 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-f75fbc36-7416-4178-ad78-be9b2ed19bf2 tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['beea6cfb-69f0-4ccd-ad5d-a278c789050f', '3a100ed4-2d2e-40b0-8609-ca560f84872e', '136b00df-9efc-4850-a655-c36e0c1d5638', '33b98012-ecf4-49f7-a6f2-150b0ec952dc'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:53:45.315689 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f75fbc36-7416-4178-ad78-be9b2ed19bf2 tempest-VolumesSnapshotTestJSON-616137826 None] Delete snapshot completed successfully. May 02 10:53:45.320138 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f75fbc36-7416-4178-ad78-be9b2ed19bf2 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-be607bc2-a2fb-44f1-a3ee-998e33b7ceca-delete_snapshot'" released by "delete_snapshot" :: held 6.616s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:46.165490 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-593b1241-c5c1-4234-acb4-39cd59b4f264 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-6ee2536d-91ba-4320-971c-2695bf1ea071-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:53:46.307282 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-593b1241-c5c1-4234-acb4-39cd59b4f264 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:46.704426 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-593b1241-c5c1-4234-acb4-39cd59b4f264 tempest-VolumesSnapshotTestJSON-616137826 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:53:46.705133 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-593b1241-c5c1-4234-acb4-39cd59b4f264 tempest-VolumesSnapshotTestJSON-616137826 None] Volume volume-6ee2536d-91ba-4320-971c-2695bf1ea071 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:53:46.881828 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-593b1241-c5c1-4234-acb4-39cd59b4f264 tempest-VolumesSnapshotTestJSON-616137826 None] deleting rbd volume volume-6ee2536d-91ba-4320-971c-2695bf1ea071 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:53:52.420046 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4c958900-d48b-4f41-b3d9-243b4e3ade14 tempest-VolumesCloneTest-280710931 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:53:52.625542 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4c958900-d48b-4f41-b3d9-243b4e3ade14 tempest-VolumesCloneTest-280710931 None] deleting parent snapshot volume-98211b08-9e53-48ce-ab4e-53c37a0640eb.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:53:56.624731 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-4c958900-d48b-4f41-b3d9-243b4e3ade14 tempest-VolumesCloneTest-280710931 None] Created reservations ['7b8f05ee-d0f5-4813-bd0e-d23d0663decc', 'b96d672a-462f-4659-bb84-cb9f19a3e494', '7724dfcc-3381-4b88-9293-13757573b42c', '47daae50-6e72-4aa6-98ea-dcf44da7b80e'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:53:56.632845 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-593b1241-c5c1-4234-acb4-39cd59b4f264 tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['ea3d7c9b-49e2-40e9-9373-a06a9f4ba927', '62539a1f-1be3-4453-90f9-b3524b8f3acc', '35a712d3-d584-4f2c-846c-fe72891c44d1', 'b086775d-c5e2-4733-9d53-be3559fc5f66'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:53:56.859792 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4c958900-d48b-4f41-b3d9-243b4e3ade14 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:56.919641 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4c958900-d48b-4f41-b3d9-243b4e3ade14 tempest-VolumesCloneTest-280710931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:56.977591 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-4c958900-d48b-4f41-b3d9-243b4e3ade14 tempest-VolumesCloneTest-280710931 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:53:56.980129 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-593b1241-c5c1-4234-acb4-39cd59b4f264 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:57.010925 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-593b1241-c5c1-4234-acb4-39cd59b4f264 tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:57.032383 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-593b1241-c5c1-4234-acb4-39cd59b4f264 tempest-VolumesSnapshotTestJSON-616137826 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:53:57.037224 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4c958900-d48b-4f41-b3d9-243b4e3ade14 tempest-VolumesCloneTest-280710931 None] Deleted volume successfully. May 02 10:53:57.041059 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-593b1241-c5c1-4234-acb4-39cd59b4f264 tempest-VolumesSnapshotTestJSON-616137826 None] Deleted volume successfully. May 02 10:53:57.137228 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-4c958900-d48b-4f41-b3d9-243b4e3ade14 tempest-VolumesCloneTest-280710931 None] Lock "b'cinder-98211b08-9e53-48ce-ab4e-53c37a0640eb-delete_volume'" released by "delete_volume" :: held 12.545s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:57.196546 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-593b1241-c5c1-4234-acb4-39cd59b4f264 tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-6ee2536d-91ba-4320-971c-2695bf1ea071-delete_volume'" released by "delete_volume" :: held 11.030s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:53:57.204506 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-e20aef68-e049-43e1-b115-08db3c287aaa tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-093f3241-0113-4c40-ac60-da8e8ae38bd8-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:53:57.320703 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e20aef68-e049-43e1-b115-08db3c287aaa tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:53:57.555259 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e20aef68-e049-43e1-b115-08db3c287aaa tempest-VolumesSnapshotTestJSON-616137826 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:53:57.802964 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e20aef68-e049-43e1-b115-08db3c287aaa tempest-VolumesSnapshotTestJSON-616137826 None] deleting rbd volume volume-093f3241-0113-4c40-ac60-da8e8ae38bd8 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:54:00.703790 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:54:00.723931 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Flow 'volume_create_manager' (94d10fe7-6d58-4190-b872-49d432eb32e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:54:00.732241 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4604726e-3134-47d4-9e59-6d316c9181e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:54:00.746017 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4604726e-3134-47d4-9e59-6d316c9181e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-664992202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ccce8c18-d809-44fc-b343-79f8231c0c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2827d1e1688c459fa4a3078297cbbfc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:54:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:54:01Z,use_quota=True,user_id='fadb79774ea24b12b22150064091845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:54:00.751517 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd979b9-2e4a-4519-96a2-6488d73aaf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:54:00.755660 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd979b9-2e4a-4519-96a2-6488d73aaf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:54:00.760922 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3f431f-d340-4147-ab7b-abd1881ed7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:54:00.765546 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3f431f-d340-4147-ab7b-abd1881ed7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccce8c18-d809-44fc-b343-79f8231c0c17', 'volume_name': 'volume-ccce8c18-d809-44fc-b343-79f8231c0c17', 'volume_size': 2}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:54:00.770857 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244cb6dd-78e4-439a-ba67-75ff289b8657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:54:00.774615 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244cb6dd-78e4-439a-ba67-75ff289b8657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:54:00.780122 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa3fa14-fc77-428e-9c31-de4696fd661d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:54:00.781233 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Volume ccce8c18-d809-44fc-b343-79f8231c0c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccce8c18-d809-44fc-b343-79f8231c0c17', 'volume_size': 2} May 02 10:54:00.781626 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] creating volume 'volume-ccce8c18-d809-44fc-b343-79f8231c0c17' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:54:00.782409 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:00.805199 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:54:00.805905 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:00.835314 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:00.865342 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:54:01.620465 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:54:01.623024 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:54:01.627312 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa3fa14-fc77-428e-9c31-de4696fd661d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccce8c18-d809-44fc-b343-79f8231c0c17', 'volume_size': 2}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:54:01.632653 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5f7813-20bf-465c-9756-333c37c8f754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:54:01.709842 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Volume volume-ccce8c18-d809-44fc-b343-79f8231c0c17 (ccce8c18-d809-44fc-b343-79f8231c0c17): created successfully May 02 10:54:01.713702 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5f7813-20bf-465c-9756-333c37c8f754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:54:01.720139 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Flow 'volume_create_manager' (94d10fe7-6d58-4190-b872-49d432eb32e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:54:01.813163 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-15b821f2-699b-49c5-88ea-96d1710ca70f tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Created volume successfully. May 02 10:54:03.173297 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3c715727-af1e-4001-bc57-513204dfefc9 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:03.362146 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e20aef68-e049-43e1-b115-08db3c287aaa tempest-VolumesSnapshotTestJSON-616137826 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:54:03.512880 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e20aef68-e049-43e1-b115-08db3c287aaa tempest-VolumesSnapshotTestJSON-616137826 None] deleting parent snapshot volume-093f3241-0113-4c40-ac60-da8e8ae38bd8.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:54:07.516153 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-e20aef68-e049-43e1-b115-08db3c287aaa tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['77ce5907-1f2d-49fd-ad70-be3742c4e847', '18aa27ef-b35f-4775-ad43-79a76c97c27c', '8d67a076-f1a4-40b7-9f87-30b8e9195a10', 'b51e78ac-2e97-4054-a5df-b32c1c3b89eb'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:54:07.726341 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e20aef68-e049-43e1-b115-08db3c287aaa tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:07.771668 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e20aef68-e049-43e1-b115-08db3c287aaa tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:07.800970 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-e20aef68-e049-43e1-b115-08db3c287aaa tempest-VolumesSnapshotTestJSON-616137826 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:54:07.807269 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e20aef68-e049-43e1-b115-08db3c287aaa tempest-VolumesSnapshotTestJSON-616137826 None] Deleted volume successfully. May 02 10:54:07.871453 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-e20aef68-e049-43e1-b115-08db3c287aaa tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-093f3241-0113-4c40-ac60-da8e8ae38bd8-delete_volume'" released by "delete_volume" :: held 10.667s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:54:07.910908 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-dbe659ea-dda6-44cc-803e-3828e5bd959e tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-e80dbe72-5018-4eb1-abbb-192fc2c0d6df-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:54:07.912690 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-dbe659ea-dda6-44cc-803e-3828e5bd959e tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:08.550204 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3c715727-af1e-4001-bc57-513204dfefc9 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Create snapshot completed successfully May 02 10:54:09.390096 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-5c9d469b-f575-49d7-a7c8-beceab48c392 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Lock "b'cinder-6cf2a93b-48b3-4f17-81da-8eb21a2ca79d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:54:09.391513 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5c9d469b-f575-49d7-a7c8-beceab48c392 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:12.738731 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-dbe659ea-dda6-44cc-803e-3828e5bd959e tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['bd7a91dd-548f-48d1-a7a9-4fb76b1d6431', 'ffc793e0-f200-4060-8db5-a94565912419', '825ed440-a0da-4ff5-8cf7-f41653f79863', 'd72194ad-1946-4342-b024-621010910b35'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:54:12.910074 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-dbe659ea-dda6-44cc-803e-3828e5bd959e tempest-VolumesSnapshotTestJSON-616137826 None] Delete snapshot completed successfully. May 02 10:54:12.918002 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-dbe659ea-dda6-44cc-803e-3828e5bd959e tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-e80dbe72-5018-4eb1-abbb-192fc2c0d6df-delete_snapshot'" released by "delete_snapshot" :: held 5.004s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:54:13.296232 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a10bae32-f737-4c82-b623-7acf8818caee tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-f570807a-66b8-416f-b0c4-f488a0f13513-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:54:13.402078 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a10bae32-f737-4c82-b623-7acf8818caee tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:13.698471 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a10bae32-f737-4c82-b623-7acf8818caee tempest-VolumesSnapshotTestJSON-616137826 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:54:13.698933 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a10bae32-f737-4c82-b623-7acf8818caee tempest-VolumesSnapshotTestJSON-616137826 None] Volume volume-f570807a-66b8-416f-b0c4-f488a0f13513 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:54:13.797008 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a10bae32-f737-4c82-b623-7acf8818caee tempest-VolumesSnapshotTestJSON-616137826 None] deleting rbd volume volume-f570807a-66b8-416f-b0c4-f488a0f13513 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:54:13.934332 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-5c9d469b-f575-49d7-a7c8-beceab48c392 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Created reservations ['d7f24baa-3114-4618-b1a7-4e984becf6f4', '2fef7e8e-82f5-4151-9d2d-62b41f8de71b', '208ddcc0-6389-4613-af3c-9a40d7700616', 'daa9d153-600c-495d-aba8-160beb5b1290'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:54:14.193714 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5c9d469b-f575-49d7-a7c8-beceab48c392 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Delete snapshot completed successfully. May 02 10:54:14.194414 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-5c9d469b-f575-49d7-a7c8-beceab48c392 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Lock "b'cinder-6cf2a93b-48b3-4f17-81da-8eb21a2ca79d-delete_snapshot'" released by "delete_snapshot" :: held 4.804s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:54:14.820154 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-6407581b-8d9e-4969-8514-539c69546f83 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Lock "b'cinder-ccce8c18-d809-44fc-b343-79f8231c0c17-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:54:15.045891 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6407581b-8d9e-4969-8514-539c69546f83 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:15.299045 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6407581b-8d9e-4969-8514-539c69546f83 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:54:15.299771 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6407581b-8d9e-4969-8514-539c69546f83 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Volume volume-ccce8c18-d809-44fc-b343-79f8231c0c17 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:54:15.533294 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6407581b-8d9e-4969-8514-539c69546f83 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] deleting rbd volume volume-ccce8c18-d809-44fc-b343-79f8231c0c17 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:54:20.778518 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-a10bae32-f737-4c82-b623-7acf8818caee tempest-VolumesSnapshotTestJSON-616137826 None] Created reservations ['944c7f49-2575-494a-b016-98010c1215b2', 'a64a308a-a0d5-4124-a560-fcfe555e6054', '67fdac2e-475b-404d-9518-138616949fa3', 'bb2788c5-e1a3-40ce-8f05-073a41200ed4'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:54:20.927604 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a10bae32-f737-4c82-b623-7acf8818caee tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:20.955249 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a10bae32-f737-4c82-b623-7acf8818caee tempest-VolumesSnapshotTestJSON-616137826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:20.990060 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-a10bae32-f737-4c82-b623-7acf8818caee tempest-VolumesSnapshotTestJSON-616137826 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:54:20.996038 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a10bae32-f737-4c82-b623-7acf8818caee tempest-VolumesSnapshotTestJSON-616137826 None] Deleted volume successfully. May 02 10:54:21.091829 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-a10bae32-f737-4c82-b623-7acf8818caee tempest-VolumesSnapshotTestJSON-616137826 None] Lock "b'cinder-f570807a-66b8-416f-b0c4-f488a0f13513-delete_volume'" released by "delete_volume" :: held 7.796s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:54:21.997651 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-6407581b-8d9e-4969-8514-539c69546f83 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Created reservations ['5f5af5e6-c54a-438c-9421-a1fa5ceb7ed4', 'bdf72175-0418-4b3c-996c-e976e3471079', '3945a91d-78c1-4412-b3ad-38550bba1898', 'b1f5df49-b715-4eda-a4ac-4553a2b61bde'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:54:22.187088 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6407581b-8d9e-4969-8514-539c69546f83 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:22.249004 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6407581b-8d9e-4969-8514-539c69546f83 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:22.298615 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-6407581b-8d9e-4969-8514-539c69546f83 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:54:22.303299 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-6407581b-8d9e-4969-8514-539c69546f83 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Deleted volume successfully. May 02 10:54:22.436588 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-6407581b-8d9e-4969-8514-539c69546f83 tempest-VolumesSnapshotNegativeTestJSON-1341441066 None] Lock "b'cinder-ccce8c18-d809-44fc-b343-79f8231c0c17-delete_volume'" released by "delete_volume" :: held 7.616s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:54:56.722514 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-742a65ab-dd8c-4b16-89c5-a5ad6856694e req-903b5e96-28f2-4666-99f9-940c52150b7a tempest-TestVolumeBootPattern-406823548 None] Terminate volume connection completed successfully. May 02 10:54:56.723228 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-742a65ab-dd8c-4b16-89c5-a5ad6856694e req-903b5e96-28f2-4666-99f9-940c52150b7a tempest-TestVolumeBootPattern-406823548 None] Deleting attachment 536e917c-c3f8-4030-9431-5c6ce4150de5. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 10:54:59.013327 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7211579e-4797-494c-a791-efe09351a23e tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:54:59.145366 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7211579e-4797-494c-a791-efe09351a23e tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:54:59.298805 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7211579e-4797-494c-a791-efe09351a23e tempest-TestVolumeBootPattern-406823548 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:54:59.364171 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7211579e-4797-494c-a791-efe09351a23e tempest-TestVolumeBootPattern-406823548 None] deleting rbd volume volume-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:55:00.810980 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:55:00.810980 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:55:00.865223 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:55:00.929841 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:55:03.231940 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7211579e-4797-494c-a791-efe09351a23e tempest-TestVolumeBootPattern-406823548 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:55:03.354992 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7211579e-4797-494c-a791-efe09351a23e tempest-TestVolumeBootPattern-406823548 None] deleting parent snapshot volume-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:55:05.629878 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-7211579e-4797-494c-a791-efe09351a23e tempest-TestVolumeBootPattern-406823548 None] Created reservations ['f8d2bcf7-76e1-4a3c-81df-ca367935624b', 'e6b4d269-01c2-4d6c-b303-691f9edcd86e', 'a56e4541-b82c-4ae3-94cb-fd61377ffa53', 'fe14567e-17f1-4748-ac36-5b53b6cd5e42'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:55:05.854108 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7211579e-4797-494c-a791-efe09351a23e tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:55:05.922946 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-7211579e-4797-494c-a791-efe09351a23e tempest-TestVolumeBootPattern-406823548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:55:05.967514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-7211579e-4797-494c-a791-efe09351a23e tempest-TestVolumeBootPattern-406823548 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:55:05.973173 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-7211579e-4797-494c-a791-efe09351a23e tempest-TestVolumeBootPattern-406823548 None] Deleted volume successfully. May 02 10:55:06.056695 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-7211579e-4797-494c-a791-efe09351a23e tempest-TestVolumeBootPattern-406823548 None] Lock "b'cinder-9b4fd3c5-cdb8-46cf-9c7b-33d75f2eef37-delete_volume'" released by "delete_volume" :: held 7.043s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:55:38.860999 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:55:38.887276 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Flow 'volume_create_manager' (04f36423-4aa9-49a5-a10c-005c29cf10d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:55:38.895561 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c31629-a611-4b0d-9e66-a035221785e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:55:38.912504 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c31629-a611-4b0d-9e66-a035221785e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1360231769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=44a01f47-ef88-48e4-86e7-fbb5d1248921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb679ab3c4249398fb3abd91c44c8bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:55:39Z,use_quota=True,user_id='e4e782af7347483bb0548443e32678f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:55:38.923493 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49176c9b-2f1a-4509-85f6-26281154d47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:55:38.928282 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49176c9b-2f1a-4509-85f6-26281154d47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:55:38.934001 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86563b5-b3e5-4eac-8548-77c3b6054626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:55:38.939104 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86563b5-b3e5-4eac-8548-77c3b6054626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a01f47-ef88-48e4-86e7-fbb5d1248921', 'volume_name': 'volume-44a01f47-ef88-48e4-86e7-fbb5d1248921', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:55:38.944295 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f497966f-ee14-4b39-ad7b-6f72aa6bb5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:55:38.949205 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f497966f-ee14-4b39-ad7b-6f72aa6bb5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:55:38.954582 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683acab4-cd2a-408e-b557-35f7f828471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:55:38.955934 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Volume 44a01f47-ef88-48e4-86e7-fbb5d1248921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a01f47-ef88-48e4-86e7-fbb5d1248921', 'volume_size': 1} May 02 10:55:38.956488 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] creating volume 'volume-44a01f47-ef88-48e4-86e7-fbb5d1248921' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:55:38.957466 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:55:39.570586 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:55:39.571249 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:55:39.575870 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683acab4-cd2a-408e-b557-35f7f828471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a01f47-ef88-48e4-86e7-fbb5d1248921', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:55:39.581323 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd41c73c-d58e-4027-a944-4c74fd60b2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:55:39.631960 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Volume volume-44a01f47-ef88-48e4-86e7-fbb5d1248921 (44a01f47-ef88-48e4-86e7-fbb5d1248921): created successfully May 02 10:55:39.643359 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd41c73c-d58e-4027-a944-4c74fd60b2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:55:39.650292 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Flow 'volume_create_manager' (04f36423-4aa9-49a5-a10c-005c29cf10d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:55:39.705581 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-70dfbacb-db54-4289-bf1e-8533aa9cff5e tempest-SnapshotsActionsTest-1160106714 None] Created volume successfully. May 02 10:55:41.461993 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-51074db7-f22d-4e94-8285-0d343e9f170b tempest-SnapshotsActionsTest-1160106714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:55:44.207001 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-51074db7-f22d-4e94-8285-0d343e9f170b tempest-SnapshotsActionsTest-1160106714 None] Create snapshot completed successfully May 02 10:55:45.492703 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b5e15d98-60a5-4364-9ceb-965cf63ddcc4 tempest-SnapshotsActionsTest-1160106714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:55:47.823338 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b5e15d98-60a5-4364-9ceb-965cf63ddcc4 tempest-SnapshotsActionsTest-1160106714 None] Create snapshot completed successfully May 02 10:55:48.624950 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-89188ef3-7dd1-46c5-b280-cb6c26ade8a9 tempest-SnapshotsActionsTest-1951726967 None] Lock "b'cinder-d4eac425-def9-4bb6-a76b-745a9494439d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:55:48.626741 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-89188ef3-7dd1-46c5-b280-cb6c26ade8a9 tempest-SnapshotsActionsTest-1951726967 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:55:51.476090 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-89188ef3-7dd1-46c5-b280-cb6c26ade8a9 tempest-SnapshotsActionsTest-1951726967 None] Created reservations ['31c34b09-55a6-45bb-9b8c-7782bf2a21f4', 'da1a6027-e435-4ca9-9b89-9f4ff12a6a3c', '258be600-f71d-48ac-953a-3b298b146e29', '1a7fff6b-dc56-4222-ad0e-809e252b0aaa'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:55:51.682061 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-89188ef3-7dd1-46c5-b280-cb6c26ade8a9 tempest-SnapshotsActionsTest-1951726967 None] Delete snapshot completed successfully. May 02 10:55:51.689780 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-89188ef3-7dd1-46c5-b280-cb6c26ade8a9 tempest-SnapshotsActionsTest-1951726967 None] Lock "b'cinder-d4eac425-def9-4bb6-a76b-745a9494439d-delete_snapshot'" released by "delete_snapshot" :: held 3.065s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:55:52.459093 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-688c3a2a-0426-4910-8df8-ae9c2bb724f5 tempest-SnapshotsActionsTest-1160106714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:55:54.286955 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-688c3a2a-0426-4910-8df8-ae9c2bb724f5 tempest-SnapshotsActionsTest-1160106714 None] Create snapshot completed successfully May 02 10:55:54.691491 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-cc6c718e-4b23-46d6-b178-1d139ccfd343 tempest-SnapshotsActionsTest-1951726967 None] Lock "b'cinder-2bf5c249-9511-4339-b567-5789ab6e2c50-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:55:54.693176 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-cc6c718e-4b23-46d6-b178-1d139ccfd343 tempest-SnapshotsActionsTest-1951726967 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:55:57.035815 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-cc6c718e-4b23-46d6-b178-1d139ccfd343 tempest-SnapshotsActionsTest-1951726967 None] Created reservations ['6c6a0670-6b37-47f3-a237-368b2f54c664', '5f693095-8a86-4d10-901e-6cafaf2c5e85', 'c3b4553a-98eb-4ff5-9e61-ea4576ab6bda', '9f83a8cb-b0e8-45b8-828a-a857b888d4db'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:55:57.230767 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-cc6c718e-4b23-46d6-b178-1d139ccfd343 tempest-SnapshotsActionsTest-1951726967 None] Delete snapshot completed successfully. May 02 10:55:57.238157 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-cc6c718e-4b23-46d6-b178-1d139ccfd343 tempest-SnapshotsActionsTest-1951726967 None] Lock "b'cinder-2bf5c249-9511-4339-b567-5789ab6e2c50-delete_snapshot'" released by "delete_snapshot" :: held 2.545s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:55:58.524054 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6952a36f-2628-484b-ba63-08b5c4a66ccf tempest-SnapshotsActionsTest-1160106714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:00.647120 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-6952a36f-2628-484b-ba63-08b5c4a66ccf tempest-SnapshotsActionsTest-1160106714 None] Create snapshot completed successfully May 02 10:56:00.805980 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:56:00.806857 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:00.851995 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:00.878603 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:56:01.768756 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-764a01fd-3a38-4831-9666-11293eea4605 tempest-SnapshotsActionsTest-1951726967 None] Lock "b'cinder-ce225764-21fa-4b14-b008-3cfec6f57efd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:56:01.770212 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-764a01fd-3a38-4831-9666-11293eea4605 tempest-SnapshotsActionsTest-1951726967 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:04.407271 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-764a01fd-3a38-4831-9666-11293eea4605 tempest-SnapshotsActionsTest-1951726967 None] Created reservations ['e8302338-56af-49ba-a858-3a2cd7f382bb', '5d8e507e-1499-4ce9-86ff-549122fa860a', '53679155-8c62-490a-ae6a-0bf5cb828bd3', 'd8c09ce5-f029-41e6-a544-3cca0ed561f4'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:04.584660 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-764a01fd-3a38-4831-9666-11293eea4605 tempest-SnapshotsActionsTest-1951726967 None] Delete snapshot completed successfully. May 02 10:56:04.590365 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-764a01fd-3a38-4831-9666-11293eea4605 tempest-SnapshotsActionsTest-1951726967 None] Lock "b'cinder-ce225764-21fa-4b14-b008-3cfec6f57efd-delete_snapshot'" released by "delete_snapshot" :: held 2.821s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:56:05.575519 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-33f647d6-5904-4334-992f-107763470455 tempest-SnapshotsActionsTest-1160106714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:07.063399 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-33f647d6-5904-4334-992f-107763470455 tempest-SnapshotsActionsTest-1160106714 None] Create snapshot completed successfully May 02 10:56:07.773216 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-ae932ca9-cca0-4ed2-9694-0e5686c68d41 tempest-SnapshotsActionsTest-1951726967 None] Lock "b'cinder-610bc50a-e7ad-42d1-9c04-031ec80ba356-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:56:07.774907 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-ae932ca9-cca0-4ed2-9694-0e5686c68d41 tempest-SnapshotsActionsTest-1951726967 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:09.432232 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-338ded20-9a68-42e8-821b-0ee086f6c0b2 tempest-GroupSnapshotsTest-206173987 None] Group tempest-GroupSnapshotsTest-Group-558542436: creating May 02 10:56:09.500959 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-338ded20-9a68-42e8-821b-0ee086f6c0b2 tempest-GroupSnapshotsTest-206173987 None] Group tempest-GroupSnapshotsTest-Group-558542436: created successfully May 02 10:56:09.514375 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-338ded20-9a68-42e8-821b-0ee086f6c0b2 tempest-GroupSnapshotsTest-206173987 None] Create group completed successfully. May 02 10:56:10.350802 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-ae932ca9-cca0-4ed2-9694-0e5686c68d41 tempest-SnapshotsActionsTest-1951726967 None] Created reservations ['ea66ba23-546e-4e58-b416-ab09ab08ccb4', 'cfe810e4-62d0-4781-bd76-ab2336e707d5', 'f64cfae8-6585-4d1c-b9d1-eeef25a0e2df', '9cd98736-d0d3-4749-b72d-5a82b5eabf84'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:10.529598 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-ae932ca9-cca0-4ed2-9694-0e5686c68d41 tempest-SnapshotsActionsTest-1951726967 None] Delete snapshot completed successfully. May 02 10:56:10.539763 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-ae932ca9-cca0-4ed2-9694-0e5686c68d41 tempest-SnapshotsActionsTest-1951726967 None] Lock "b'cinder-610bc50a-e7ad-42d1-9c04-031ec80ba356-delete_snapshot'" released by "delete_snapshot" :: held 2.765s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:56:11.466061 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:56:11.486656 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Flow 'volume_create_manager' (16e0c0fe-1f0f-484a-bf2d-4242ee2a04d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:56:11.493584 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13dc7e2-8777-4df7-b714-baf114e49dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:11.511350 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13dc7e2-8777-4df7-b714-baf114e49dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1675919101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74aaaefc-f60b-4719-9d2f-3a20165a90ff,host='ncdv-master-1@ceph#ceph',id=5f20a31f-53c5-4e86-bd9b-e986cb800388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5579201e7ef47d0a5f56c4c0cff6612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:56:11Z,use_quota=True,user_id='cab0b88500b7427ca47c70559236f8e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984db480-6433-408d-bfcf-39b26e2d99bd),volume_type_id=984db480-6433-408d-bfcf-39b26e2d99bd)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:11.517798 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b12327f-50c3-484b-a342-40a2b16d933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:11.521932 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b12327f-50c3-484b-a342-40a2b16d933c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:11.527138 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9817d85-08c2-49a2-81fb-08466f7f023b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:11.532050 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9817d85-08c2-49a2-81fb-08466f7f023b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f20a31f-53c5-4e86-bd9b-e986cb800388', 'volume_name': 'volume-5f20a31f-53c5-4e86-bd9b-e986cb800388', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:11.537100 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e1d028-2a01-49b3-805b-e6b745827bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:11.541088 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e1d028-2a01-49b3-805b-e6b745827bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:11.546346 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1b4c61-4bf7-4646-b170-3b0bcbc8f330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:11.547815 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Volume 5f20a31f-53c5-4e86-bd9b-e986cb800388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f20a31f-53c5-4e86-bd9b-e986cb800388', 'volume_size': 1} May 02 10:56:11.548212 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] creating volume 'volume-5f20a31f-53c5-4e86-bd9b-e986cb800388' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:56:11.549277 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:11.731704 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f64c2321-d820-4797-a964-5e89d580ea12 tempest-SnapshotsActionsTest-1160106714 None] Lock "b'cinder-a790b428-6674-4056-b36a-ec92b962f8ea-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:56:11.733241 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f64c2321-d820-4797-a964-5e89d580ea12 tempest-SnapshotsActionsTest-1160106714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:12.135873 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:56:12.136255 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:56:12.140577 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1b4c61-4bf7-4646-b170-3b0bcbc8f330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f20a31f-53c5-4e86-bd9b-e986cb800388', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:12.145347 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129ea24d-7ecd-4908-a423-123b2518e708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:12.248296 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Volume volume-5f20a31f-53c5-4e86-bd9b-e986cb800388 (5f20a31f-53c5-4e86-bd9b-e986cb800388): created successfully May 02 10:56:12.252278 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129ea24d-7ecd-4908-a423-123b2518e708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:12.258312 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Flow 'volume_create_manager' (16e0c0fe-1f0f-484a-bf2d-4242ee2a04d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:56:12.357301 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f07136b7-9ca1-4ee2-a94a-1b2927d016f8 tempest-GroupSnapshotsTest-206173987 None] Created volume successfully. May 02 10:56:13.788870 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-17de429f-a9bd-4b54-a873-f941473516b0 tempest-GroupSnapshotsTest-206173987 None] GroupSnapshot 134c8461-e24e-4188-a6ca-444df9b08c2b: creating. May 02 10:56:13.807352 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-17de429f-a9bd-4b54-a873-f941473516b0 tempest-GroupSnapshotsTest-206173987 None] Group snapshot 134c8461-e24e-4188-a6ca-444df9b08c2b: creating. {{(pid=123784) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} May 02 10:56:13.823676 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-17de429f-a9bd-4b54-a873-f941473516b0 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:14.395889 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-f64c2321-d820-4797-a964-5e89d580ea12 tempest-SnapshotsActionsTest-1160106714 None] Created reservations ['3b98c7c6-a2b9-4288-b8e8-a4aab79ed269', '40b2afdd-866a-4fb0-93f4-fa6c10ed3be4', '9f356f44-95d4-421a-9f37-ba186c18aabd', 'b9ad6f3c-d770-49a2-a16a-0483e861a8d1'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:14.538828 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f64c2321-d820-4797-a964-5e89d580ea12 tempest-SnapshotsActionsTest-1160106714 None] Delete snapshot completed successfully. May 02 10:56:14.543631 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f64c2321-d820-4797-a964-5e89d580ea12 tempest-SnapshotsActionsTest-1160106714 None] Lock "b'cinder-a790b428-6674-4056-b36a-ec92b962f8ea-delete_snapshot'" released by "delete_snapshot" :: held 2.812s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:56:15.085166 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f4130ab0-b9b8-4f71-8e30-4cb04b522d7e tempest-SnapshotsActionsTest-1160106714 None] Lock "b'cinder-44a01f47-ef88-48e4-86e7-fbb5d1248921-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:56:15.230699 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f4130ab0-b9b8-4f71-8e30-4cb04b522d7e tempest-SnapshotsActionsTest-1160106714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:15.492548 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f4130ab0-b9b8-4f71-8e30-4cb04b522d7e tempest-SnapshotsActionsTest-1160106714 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:56:15.493012 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f4130ab0-b9b8-4f71-8e30-4cb04b522d7e tempest-SnapshotsActionsTest-1160106714 None] Volume volume-44a01f47-ef88-48e4-86e7-fbb5d1248921 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:56:15.664480 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f4130ab0-b9b8-4f71-8e30-4cb04b522d7e tempest-SnapshotsActionsTest-1160106714 None] deleting rbd volume volume-44a01f47-ef88-48e4-86e7-fbb5d1248921 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:56:16.887348 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-17de429f-a9bd-4b54-a873-f941473516b0 tempest-GroupSnapshotsTest-206173987 None] group_snapshot 134c8461-e24e-4188-a6ca-444df9b08c2b: created successfully May 02 10:56:17.928833 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3c16da20-3d75-48da-ab98-951b3d54961d tempest-GroupSnapshotsTest-206173987 None] cloning volumes/volume-5f20a31f-53c5-4e86-bd9b-e986cb800388@snapshot-aca7be7c-4061-487e-acfc-996f05308ffe to volume-e3457ae2-f205-4694-8afc-cc2f683e8fc0 {{(pid=123784) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 02 10:56:17.929524 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3c16da20-3d75-48da-ab98-951b3d54961d tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:17.963668 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3c16da20-3d75-48da-ab98-951b3d54961d tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:19.814446 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3c16da20-3d75-48da-ab98-951b3d54961d tempest-GroupSnapshotsTest-206173987 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:56:19.815183 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3c16da20-3d75-48da-ab98-951b3d54961d tempest-GroupSnapshotsTest-206173987 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:56:20.136897 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3c16da20-3d75-48da-ab98-951b3d54961d tempest-GroupSnapshotsTest-206173987 None] Create group from source-snapshot-134c8461-e24e-4188-a6ca-444df9b08c2b completed successfully. May 02 10:56:20.586889 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5cb73373-f562-4bc9-9cd4-c73e26b874d0 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:20.794991 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5cb73373-f562-4bc9-9cd4-c73e26b874d0 tempest-GroupSnapshotsTest-206173987 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:56:20.870374 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5cb73373-f562-4bc9-9cd4-c73e26b874d0 tempest-GroupSnapshotsTest-206173987 None] deleting rbd volume volume-e3457ae2-f205-4694-8afc-cc2f683e8fc0 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:56:20.872840 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-f4130ab0-b9b8-4f71-8e30-4cb04b522d7e tempest-SnapshotsActionsTest-1160106714 None] Created reservations ['ca1394ad-89c9-4524-994b-c0e868546425', '642cfff3-8ab1-4405-b04f-46e564f53942', '07be307a-b08f-44c2-8590-1f8756200fe0', 'bd591a31-ace1-4fff-a3c4-e24b3cbedd84'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:21.138591 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f4130ab0-b9b8-4f71-8e30-4cb04b522d7e tempest-SnapshotsActionsTest-1160106714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:21.217701 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f4130ab0-b9b8-4f71-8e30-4cb04b522d7e tempest-SnapshotsActionsTest-1160106714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:21.241181 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-f4130ab0-b9b8-4f71-8e30-4cb04b522d7e tempest-SnapshotsActionsTest-1160106714 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:56:21.245481 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f4130ab0-b9b8-4f71-8e30-4cb04b522d7e tempest-SnapshotsActionsTest-1160106714 None] Deleted volume successfully. May 02 10:56:21.331470 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f4130ab0-b9b8-4f71-8e30-4cb04b522d7e tempest-SnapshotsActionsTest-1160106714 None] Lock "b'cinder-44a01f47-ef88-48e4-86e7-fbb5d1248921-delete_volume'" released by "delete_volume" :: held 6.246s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:56:25.080993 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-5cb73373-f562-4bc9-9cd4-c73e26b874d0 tempest-GroupSnapshotsTest-206173987 None] Created reservations ['577a33cc-2853-46ad-a6bb-41c21f6dd47a'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:25.102891 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-5cb73373-f562-4bc9-9cd4-c73e26b874d0 tempest-GroupSnapshotsTest-206173987 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-350615143 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-350615143, it is now deprecated. Please use the default quota class for default quota. May 02 10:56:25.103709 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-5cb73373-f562-4bc9-9cd4-c73e26b874d0 tempest-GroupSnapshotsTest-206173987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-350615143 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-350615143, it is now deprecated. Please use the default quota class for default quota. May 02 10:56:25.201491 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-5cb73373-f562-4bc9-9cd4-c73e26b874d0 tempest-GroupSnapshotsTest-206173987 None] Created reservations ['ae727816-3dff-40ce-a69d-29e510be2fe6', '57a2c6ab-6e07-415f-8eea-8b1be9f1206a', 'e850b9ea-b078-404c-bed6-3b5c33009df5', '987c17f2-dd56-4583-be75-78ebae2e6dd3'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:25.543016 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5cb73373-f562-4bc9-9cd4-c73e26b874d0 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:25.569449 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5cb73373-f562-4bc9-9cd4-c73e26b874d0 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:25.598654 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-5cb73373-f562-4bc9-9cd4-c73e26b874d0 tempest-GroupSnapshotsTest-206173987 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:56:25.606357 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5cb73373-f562-4bc9-9cd4-c73e26b874d0 tempest-GroupSnapshotsTest-206173987 None] Delete group completed successfully. May 02 10:56:26.116119 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-1cf8c741-cbe5-4c36-b6b9-38da56d87bfc tempest-GroupSnapshotsTest-206173987 None] group_snapshot 134c8461-e24e-4188-a6ca-444df9b08c2b: deleting May 02 10:56:26.131612 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-1cf8c741-cbe5-4c36-b6b9-38da56d87bfc tempest-GroupSnapshotsTest-206173987 None] group_snapshot 134c8461-e24e-4188-a6ca-444df9b08c2b: deleting {{(pid=123784) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} May 02 10:56:26.148024 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1cf8c741-cbe5-4c36-b6b9-38da56d87bfc tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:26.477109 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:56:26.496572 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Flow 'volume_create_manager' (b17d3884-96d0-4968-b45a-5395faa50035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:56:26.503391 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5698ad-d233-4296-b2c9-8ef72a0d859c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:26.519276 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5698ad-d233-4296-b2c9-8ef72a0d859c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1354433583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fd475ab2-ace9-48a1-9b2d-c7859bf3d660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c967c4c413428cbeb1fc59f2f41710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:56:26Z,use_quota=True,user_id='03afd042adef4f12bbcf4b9d27fd3e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f62a432-c2d3-4686-a1fc-f16cc1c64f41),volume_type_id=8f62a432-c2d3-4686-a1fc-f16cc1c64f41)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:26.524710 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e2cee7-a7db-46e4-bc5b-1c5b5e314a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:26.528842 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e2cee7-a7db-46e4-bc5b-1c5b5e314a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:26.534691 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c546f526-7bf6-4320-8a57-663c4ae1f311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:26.538775 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c546f526-7bf6-4320-8a57-663c4ae1f311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd475ab2-ace9-48a1-9b2d-c7859bf3d660', 'volume_name': 'volume-fd475ab2-ace9-48a1-9b2d-c7859bf3d660', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:26.543706 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5b4ec2-d889-4609-893f-9d8485f7b327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:26.547646 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5b4ec2-d889-4609-893f-9d8485f7b327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:26.552373 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1371a5de-7f9f-4cd5-82b7-9aec3cd3a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:26.553467 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Volume fd475ab2-ace9-48a1-9b2d-c7859bf3d660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd475ab2-ace9-48a1-9b2d-c7859bf3d660', 'volume_size': 1} May 02 10:56:26.553855 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] creating volume 'volume-fd475ab2-ace9-48a1-9b2d-c7859bf3d660' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:56:26.554618 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:27.214276 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:56:27.214925 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:56:27.218479 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1371a5de-7f9f-4cd5-82b7-9aec3cd3a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd475ab2-ace9-48a1-9b2d-c7859bf3d660', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:27.223328 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91d1324-2391-49fc-b856-e4a4d9c52e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:27.332407 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Volume volume-fd475ab2-ace9-48a1-9b2d-c7859bf3d660 (fd475ab2-ace9-48a1-9b2d-c7859bf3d660): created successfully May 02 10:56:27.336565 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91d1324-2391-49fc-b856-e4a4d9c52e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:27.342189 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Flow 'volume_create_manager' (b17d3884-96d0-4968-b45a-5395faa50035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:56:27.408305 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-28db390e-c74d-4191-a694-357fdc4f4720 tempest-VolumeTypesTest-233929682 None] Created volume successfully. May 02 10:56:28.297807 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-1cf8c741-cbe5-4c36-b6b9-38da56d87bfc tempest-GroupSnapshotsTest-206173987 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-350615143 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-350615143, it is now deprecated. Please use the default quota class for default quota. May 02 10:56:28.389392 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-1cf8c741-cbe5-4c36-b6b9-38da56d87bfc tempest-GroupSnapshotsTest-206173987 None] Created reservations ['f7141802-d381-4e53-94ff-1f6a55638ce7', '3b1ec7e8-7704-44cf-82e7-b06459e16903', '6600b453-cd97-4870-aefd-77f2f92f91ff', '591734f4-b705-43f6-9050-1c9c41512daa'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:28.618196 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-1cf8c741-cbe5-4c36-b6b9-38da56d87bfc tempest-GroupSnapshotsTest-206173987 None] group_snapshot 134c8461-e24e-4188-a6ca-444df9b08c2b: deleted successfully May 02 10:56:29.116250 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-95e55c7a-cf71-486e-986e-a78021ec0a4a tempest-VolumeTypesTest-233929682 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:29.137556 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-95e55c7a-cf71-486e-986e-a78021ec0a4a tempest-VolumeTypesTest-233929682 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:29.160403 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-95e55c7a-cf71-486e-986e-a78021ec0a4a tempest-VolumeTypesTest-233929682 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:56:29.164359 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-95e55c7a-cf71-486e-986e-a78021ec0a4a tempest-VolumeTypesTest-233929682 None] Retype volume completed successfully. May 02 10:56:29.661886 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f439f27-2902-4974-9747-9edbd9670e35 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:29.835228 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f439f27-2902-4974-9747-9edbd9670e35 tempest-GroupSnapshotsTest-206173987 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:56:29.835657 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f439f27-2902-4974-9747-9edbd9670e35 tempest-GroupSnapshotsTest-206173987 None] Volume volume-5f20a31f-53c5-4e86-bd9b-e986cb800388 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:56:29.927468 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f439f27-2902-4974-9747-9edbd9670e35 tempest-GroupSnapshotsTest-206173987 None] deleting rbd volume volume-5f20a31f-53c5-4e86-bd9b-e986cb800388 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:56:31.559327 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] Lock "b'cinder-fd475ab2-ace9-48a1-9b2d-c7859bf3d660-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:56:31.636769 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:31.910050 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:56:31.910409 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] Volume volume-fd475ab2-ace9-48a1-9b2d-c7859bf3d660 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:56:32.075369 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] deleting rbd volume volume-fd475ab2-ace9-48a1-9b2d-c7859bf3d660 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:56:34.617957 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-5f439f27-2902-4974-9747-9edbd9670e35 tempest-GroupSnapshotsTest-206173987 None] Created reservations ['2f950223-f0ba-41cf-801e-b51466411f0e'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:34.646407 ncdv-master-1 cinder-volume[123784]: WARNING cinder.db.sqlalchemy.api [None req-5f439f27-2902-4974-9747-9edbd9670e35 tempest-GroupSnapshotsTest-206173987 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-350615143'] May 02 10:56:34.715288 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-5f439f27-2902-4974-9747-9edbd9670e35 tempest-GroupSnapshotsTest-206173987 None] Created reservations ['ae4bdad0-f02f-44cb-bca9-2f74d0a584de', '94cc4c2f-ce5e-46c0-afb2-8e210e875044', '69e1008f-e4d3-4588-886a-c83dd69cc0a4', 'd6c966cd-7132-453e-8c7a-8344d9eb0e07'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:35.165287 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f439f27-2902-4974-9747-9edbd9670e35 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:35.239952 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-5f439f27-2902-4974-9747-9edbd9670e35 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:35.262089 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-5f439f27-2902-4974-9747-9edbd9670e35 tempest-GroupSnapshotsTest-206173987 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:56:35.266153 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-5f439f27-2902-4974-9747-9edbd9670e35 tempest-GroupSnapshotsTest-206173987 None] Delete group completed successfully. May 02 10:56:35.994290 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-160727067 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-160727067, it is now deprecated. Please use the default quota class for default quota. May 02 10:56:35.995087 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-160727067 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-160727067, it is now deprecated. Please use the default quota class for default quota. May 02 10:56:36.092385 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] Created reservations ['940389c0-c448-4079-b81d-66cff7d402bf', '8aee2005-1797-4987-8d7f-e50f7623a440', '9ceee285-774a-4f39-947b-e01fb5976d5d', '4439ff3f-aaba-4df8-851b-c135c86dfff6'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:36.293244 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:36.316247 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:36.338590 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:56:36.342610 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] Deleted volume successfully. May 02 10:56:36.410883 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-6b87c36a-3a03-4d09-9dea-0c391e2868a3 tempest-VolumeTypesTest-233929682 None] Lock "b'cinder-fd475ab2-ace9-48a1-9b2d-c7859bf3d660-delete_volume'" released by "delete_volume" :: held 4.852s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:56:36.742145 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-d6f7e8ea-78c3-4309-b75e-56c34cd61dcb tempest-GroupSnapshotsTest-206173987 None] Group tempest-GroupSnapshotsTest-Group-2104323049: creating May 02 10:56:36.827234 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-d6f7e8ea-78c3-4309-b75e-56c34cd61dcb tempest-GroupSnapshotsTest-206173987 None] Group tempest-GroupSnapshotsTest-Group-2104323049: created successfully May 02 10:56:36.836065 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-d6f7e8ea-78c3-4309-b75e-56c34cd61dcb tempest-GroupSnapshotsTest-206173987 None] Create group completed successfully. May 02 10:56:38.528125 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:56:38.549380 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Flow 'volume_create_manager' (9cb435ed-6fe9-4589-ba0d-146d8812c666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:56:38.556107 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d4e1fa-ea83-4bde-824b-8d295dffd065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:38.571557 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d4e1fa-ea83-4bde-824b-8d295dffd065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-398380842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b34d1cf-5247-454e-8b0b-dfc2588b27b6,host='ncdv-master-1@ceph#ceph',id=a0af6ae4-b52a-49fb-b449-ea6e0b746ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5579201e7ef47d0a5f56c4c0cff6612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:56:38Z,use_quota=True,user_id='cab0b88500b7427ca47c70559236f8e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(530960e1-3999-4c2b-975e-f629eb9d4eea),volume_type_id=530960e1-3999-4c2b-975e-f629eb9d4eea)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:38.577125 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e1501e-791d-48b6-9a30-bc0e2767aaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:38.581848 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e1501e-791d-48b6-9a30-bc0e2767aaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:38.587069 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68111fa3-0cb5-467a-9538-9f09f1e6db74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:38.591219 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68111fa3-0cb5-467a-9538-9f09f1e6db74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0af6ae4-b52a-49fb-b449-ea6e0b746ca5', 'volume_name': 'volume-a0af6ae4-b52a-49fb-b449-ea6e0b746ca5', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:38.596332 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10791fc5-8749-4175-9f12-1a93dfd0647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:38.600998 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10791fc5-8749-4175-9f12-1a93dfd0647a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:38.605956 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73506fe4-efa0-4900-9a67-f4d66d936d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:38.607058 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Volume a0af6ae4-b52a-49fb-b449-ea6e0b746ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0af6ae4-b52a-49fb-b449-ea6e0b746ca5', 'volume_size': 1} May 02 10:56:38.607455 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] creating volume 'volume-a0af6ae4-b52a-49fb-b449-ea6e0b746ca5' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:56:38.608240 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:39.054482 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:56:39.054863 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:56:39.058678 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73506fe4-efa0-4900-9a67-f4d66d936d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0af6ae4-b52a-49fb-b449-ea6e0b746ca5', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:39.063535 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c857c89e-8e13-481f-8035-35df27011e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:39.132869 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Volume volume-a0af6ae4-b52a-49fb-b449-ea6e0b746ca5 (a0af6ae4-b52a-49fb-b449-ea6e0b746ca5): created successfully May 02 10:56:39.136764 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c857c89e-8e13-481f-8035-35df27011e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:39.142594 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Flow 'volume_create_manager' (9cb435ed-6fe9-4589-ba0d-146d8812c666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:56:39.229996 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-d138d03a-f473-480e-814a-aa3b79e973a9 tempest-GroupSnapshotsTest-206173987 None] Created volume successfully. May 02 10:56:40.265836 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:56:40.286692 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Flow 'volume_create_manager' (a3a767a4-ea50-4461-9e00-a151ad7d50fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:56:40.293417 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23fef7d4-8f2f-4151-a210-1f83dc3c4c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:40.310139 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23fef7d4-8f2f-4151-a210-1f83dc3c4c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-448750414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b34d1cf-5247-454e-8b0b-dfc2588b27b6,host='ncdv-master-1@ceph#ceph',id=2f0bb697-1661-45a1-8e68-8a52112b801e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5579201e7ef47d0a5f56c4c0cff6612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:56:40Z,use_quota=True,user_id='cab0b88500b7427ca47c70559236f8e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(530960e1-3999-4c2b-975e-f629eb9d4eea),volume_type_id=530960e1-3999-4c2b-975e-f629eb9d4eea)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:40.315879 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d8582f-e005-42ba-a2c6-746372c7a8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:40.320102 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d8582f-e005-42ba-a2c6-746372c7a8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:40.325441 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f9f185a-d5db-4ca2-87f9-e02047ed031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:40.329659 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f9f185a-d5db-4ca2-87f9-e02047ed031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0bb697-1661-45a1-8e68-8a52112b801e', 'volume_name': 'volume-2f0bb697-1661-45a1-8e68-8a52112b801e', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:40.335320 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34c40c7-231f-4b50-a726-347e60cdb265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:40.339374 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34c40c7-231f-4b50-a726-347e60cdb265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:40.344625 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28544341-1374-4225-8d50-c704a1651540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:40.345776 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Volume 2f0bb697-1661-45a1-8e68-8a52112b801e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0bb697-1661-45a1-8e68-8a52112b801e', 'volume_size': 1} May 02 10:56:40.346168 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] creating volume 'volume-2f0bb697-1661-45a1-8e68-8a52112b801e' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:56:40.347471 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:40.794008 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:56:40.794008 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:56:40.797241 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28544341-1374-4225-8d50-c704a1651540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0bb697-1661-45a1-8e68-8a52112b801e', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:40.802457 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0498dad8-8940-4995-a818-329e03331e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:40.847122 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Volume volume-2f0bb697-1661-45a1-8e68-8a52112b801e (2f0bb697-1661-45a1-8e68-8a52112b801e): created successfully May 02 10:56:40.850925 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0498dad8-8940-4995-a818-329e03331e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:40.856914 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Flow 'volume_create_manager' (a3a767a4-ea50-4461-9e00-a151ad7d50fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:56:40.921264 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-facce331-632e-4750-804c-216ef44abdf4 tempest-GroupSnapshotsTest-206173987 None] Created volume successfully. May 02 10:56:41.392177 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b7ddad89-c72f-4290-a31f-2ce00c435494 tempest-GroupSnapshotsTest-206173987 None] Update group completed successfully. May 02 10:56:42.554245 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-8ea90e9e-4dca-4917-955d-570b358d362a tempest-GroupSnapshotsTest-206173987 None] Update group completed successfully. May 02 10:56:43.718943 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-47edc03e-6666-4ce0-8e38-90be92c92917 tempest-GroupSnapshotsTest-206173987 None] Update group completed successfully. May 02 10:56:44.942839 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2f7b55b9-7c96-45a2-937f-371ecf09b1b5 tempest-GroupSnapshotsTest-206173987 None] Update group completed successfully. May 02 10:56:46.594072 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-10f13c7a-a72f-4415-a199-fec7c24e7229 tempest-GroupSnapshotsTest-206173987 None] GroupSnapshot 8383b3dc-e891-4b93-830c-ff2a6be1e0e1: creating. May 02 10:56:46.614723 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-10f13c7a-a72f-4415-a199-fec7c24e7229 tempest-GroupSnapshotsTest-206173987 None] Group snapshot 8383b3dc-e891-4b93-830c-ff2a6be1e0e1: creating. {{(pid=123784) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} May 02 10:56:46.630586 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-10f13c7a-a72f-4415-a199-fec7c24e7229 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:48.745931 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-10f13c7a-a72f-4415-a199-fec7c24e7229 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:49.374373 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:56:49.393784 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (a33cb06e-b035-42ca-af95-7a2b966b8d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:56:49.401429 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f00a09c-e970-4098-a483-9ef3a756b711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:49.416218 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f00a09c-e970-4098-a483-9ef3a756b711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1574577876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=db851d4d-3c84-4207-a9d0-dd0544cb0dcc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2414cc78d8648ed91a1527ecf826bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:56:49Z,use_quota=True,user_id='1cfbc4371862424ab7c6ff88c6fc009d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:49.421740 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9a1df8-a68b-4257-a26a-4e3c99a3a0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:49.425973 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9a1df8-a68b-4257-a26a-4e3c99a3a0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:49.431257 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff9f822-5e40-460a-93e3-203139dae80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:49.435488 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff9f822-5e40-460a-93e3-203139dae80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db851d4d-3c84-4207-a9d0-dd0544cb0dcc', 'volume_name': 'volume-db851d4d-3c84-4207-a9d0-dd0544cb0dcc', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:49.440544 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c607a4-11e6-41ca-96b0-2d397b2e33ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:49.444528 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c607a4-11e6-41ca-96b0-2d397b2e33ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:49.449917 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc11733-c7bf-407f-bc96-7ecdd6f243b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:49.450983 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Volume db851d4d-3c84-4207-a9d0-dd0544cb0dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db851d4d-3c84-4207-a9d0-dd0544cb0dcc', 'volume_size': 1} May 02 10:56:49.451376 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] creating volume 'volume-db851d4d-3c84-4207-a9d0-dd0544cb0dcc' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:56:49.452024 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:49.952252 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:56:49.952899 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:56:49.956801 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc11733-c7bf-407f-bc96-7ecdd6f243b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db851d4d-3c84-4207-a9d0-dd0544cb0dcc', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:49.961872 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa2edbf-adb7-4de5-b097-54bbae2b9db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:50.046795 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Volume volume-db851d4d-3c84-4207-a9d0-dd0544cb0dcc (db851d4d-3c84-4207-a9d0-dd0544cb0dcc): created successfully May 02 10:56:50.050556 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa2edbf-adb7-4de5-b097-54bbae2b9db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:50.056853 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (a33cb06e-b035-42ca-af95-7a2b966b8d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:56:50.178203 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-766b4921-1283-47b3-9ed3-a3915bb462f0 tempest-VolumesGetTest-171462808 None] Created volume successfully. May 02 10:56:51.093612 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:56:51.112982 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (3c20bb8c-37e2-408f-aaea-2c0f311c534d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:56:51.119906 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8df3ed-8c62-4a72-9704-f7919c5527e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:51.135796 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8df3ed-8c62-4a72-9704-f7919c5527e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:56:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-537951105',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d938a82e-8f3d-4db2-9b92-373dbba5057a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2414cc78d8648ed91a1527ecf826bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:56:51Z,use_quota=True,user_id='1cfbc4371862424ab7c6ff88c6fc009d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:51.141505 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052e27c3-f564-4064-9f3d-e0c7b26d5804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:51.145753 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052e27c3-f564-4064-9f3d-e0c7b26d5804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:51.151063 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6628594b-bd20-4952-8c6a-0a0156311f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:51.155158 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6628594b-bd20-4952-8c6a-0a0156311f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd938a82e-8f3d-4db2-9b92-373dbba5057a', 'volume_name': 'volume-d938a82e-8f3d-4db2-9b92-373dbba5057a', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:51.160162 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fd6eb1-737b-4748-8442-288a8b495cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:51.164115 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fd6eb1-737b-4748-8442-288a8b495cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:51.168890 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60dce290-8d24-4deb-af34-14aa6cefd9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:51.169939 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Volume d938a82e-8f3d-4db2-9b92-373dbba5057a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d938a82e-8f3d-4db2-9b92-373dbba5057a', 'volume_size': 1} May 02 10:56:51.170323 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] creating volume 'volume-d938a82e-8f3d-4db2-9b92-373dbba5057a' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:56:51.171040 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:51.505363 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-10f13c7a-a72f-4415-a199-fec7c24e7229 tempest-GroupSnapshotsTest-206173987 None] group_snapshot 8383b3dc-e891-4b93-830c-ff2a6be1e0e1: created successfully May 02 10:56:51.832960 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:56:51.833342 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:56:51.840969 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60dce290-8d24-4deb-af34-14aa6cefd9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d938a82e-8f3d-4db2-9b92-373dbba5057a', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:51.842641 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4b6d25-095d-4057-92fa-95bb121e8cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:56:51.927238 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Volume volume-d938a82e-8f3d-4db2-9b92-373dbba5057a (d938a82e-8f3d-4db2-9b92-373dbba5057a): created successfully May 02 10:56:51.931897 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4b6d25-095d-4057-92fa-95bb121e8cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:56:51.937597 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (3c20bb8c-37e2-408f-aaea-2c0f311c534d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:56:52.001821 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-a2680bcd-377a-481a-8b75-aa1130af162c tempest-VolumesGetTest-171462808 None] Created volume successfully. May 02 10:56:52.104310 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-20d34611-8470-4808-8a97-a0966affb059 tempest-GroupSnapshotsTest-206173987 None] group_snapshot 8383b3dc-e891-4b93-830c-ff2a6be1e0e1: deleting May 02 10:56:52.121805 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-20d34611-8470-4808-8a97-a0966affb059 tempest-GroupSnapshotsTest-206173987 None] group_snapshot 8383b3dc-e891-4b93-830c-ff2a6be1e0e1: deleting {{(pid=123784) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} May 02 10:56:52.137332 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-20d34611-8470-4808-8a97-a0966affb059 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:53.385620 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-55848641-63b1-4613-8045-ff00031ec830 tempest-VolumesGetTest-171462808 None] Lock "b'cinder-d938a82e-8f3d-4db2-9b92-373dbba5057a-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:56:53.489406 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-55848641-63b1-4613-8045-ff00031ec830 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:53.789870 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-55848641-63b1-4613-8045-ff00031ec830 tempest-VolumesGetTest-171462808 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:56:53.790232 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-55848641-63b1-4613-8045-ff00031ec830 tempest-VolumesGetTest-171462808 None] Volume volume-d938a82e-8f3d-4db2-9b92-373dbba5057a is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:56:53.869840 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-55848641-63b1-4613-8045-ff00031ec830 tempest-VolumesGetTest-171462808 None] deleting rbd volume volume-d938a82e-8f3d-4db2-9b92-373dbba5057a {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:56:54.389042 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-20d34611-8470-4808-8a97-a0966affb059 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:58.600671 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-20d34611-8470-4808-8a97-a0966affb059 tempest-GroupSnapshotsTest-206173987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-405329176 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-405329176, it is now deprecated. Please use the default quota class for default quota. May 02 10:56:58.601467 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-20d34611-8470-4808-8a97-a0966affb059 tempest-GroupSnapshotsTest-206173987 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-405329176 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-405329176, it is now deprecated. Please use the default quota class for default quota. May 02 10:56:58.686819 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-20d34611-8470-4808-8a97-a0966affb059 tempest-GroupSnapshotsTest-206173987 None] Created reservations ['d32c0126-c115-48db-9722-036a33ccf519', '1cf0df83-4770-434c-ab61-04425d3d85c0', '8d3a191c-4a45-40cc-a81d-a2034df1c03d', 'e7885275-5c34-4dc4-8849-c0b0f81cbe46'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:58.932444 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-55848641-63b1-4613-8045-ff00031ec830 tempest-VolumesGetTest-171462808 None] Created reservations ['65efdb0b-3ab7-42ea-9967-f147a2837703', 'd98bec09-0f58-418f-adfc-3d8c9d313884', '494b8c05-49cd-4aa7-86fd-c478c5e1fdec', '832f4b20-e3a8-41f5-98ef-290151873059'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:58.949644 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-20d34611-8470-4808-8a97-a0966affb059 tempest-GroupSnapshotsTest-206173987 None] Created reservations ['33ad5095-1b85-45e8-a2f8-d0becd89a1bb', '596f532e-97b5-48fd-87f8-30c670141ef9', 'b25090f0-6223-400e-b857-731208a3552e', '4e047bbf-9e9a-4e84-a368-d85a479d2ff2'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:56:59.094050 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-55848641-63b1-4613-8045-ff00031ec830 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:59.117353 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-55848641-63b1-4613-8045-ff00031ec830 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:59.140325 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-55848641-63b1-4613-8045-ff00031ec830 tempest-VolumesGetTest-171462808 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:56:59.145837 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-55848641-63b1-4613-8045-ff00031ec830 tempest-VolumesGetTest-171462808 None] Deleted volume successfully. May 02 10:56:59.216348 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-55848641-63b1-4613-8045-ff00031ec830 tempest-VolumesGetTest-171462808 None] Lock "b'cinder-d938a82e-8f3d-4db2-9b92-373dbba5057a-delete_volume'" released by "delete_volume" :: held 5.831s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:56:59.369237 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-20d34611-8470-4808-8a97-a0966affb059 tempest-GroupSnapshotsTest-206173987 None] group_snapshot 8383b3dc-e891-4b93-830c-ff2a6be1e0e1: deleted successfully May 02 10:56:59.863294 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:56:59.966411 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:56:59.966846 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] Volume volume-2f0bb697-1661-45a1-8e68-8a52112b801e is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:57:00.064138 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] deleting rbd volume volume-2f0bb697-1661-45a1-8e68-8a52112b801e {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:57:00.072792 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-2c23a42a-a125-4b67-92eb-2fe4aacc495d tempest-VolumesGetTest-171462808 None] Lock "b'cinder-db851d4d-3c84-4207-a9d0-dd0544cb0dcc-delete_volume'" acquired by "delete_volume" :: waited 0.219s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:57:00.160145 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2c23a42a-a125-4b67-92eb-2fe4aacc495d tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:00.366174 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2c23a42a-a125-4b67-92eb-2fe4aacc495d tempest-VolumesGetTest-171462808 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:57:00.366609 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2c23a42a-a125-4b67-92eb-2fe4aacc495d tempest-VolumesGetTest-171462808 None] Volume volume-db851d4d-3c84-4207-a9d0-dd0544cb0dcc is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:57:00.601296 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2c23a42a-a125-4b67-92eb-2fe4aacc495d tempest-VolumesGetTest-171462808 None] deleting rbd volume volume-db851d4d-3c84-4207-a9d0-dd0544cb0dcc {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:57:00.805696 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:57:00.806351 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:00.826411 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:00.847878 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:57:06.314660 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:06.474958 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:57:06.475388 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] Volume volume-a0af6ae4-b52a-49fb-b449-ea6e0b746ca5 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:57:06.555391 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] deleting rbd volume volume-a0af6ae4-b52a-49fb-b449-ea6e0b746ca5 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:57:06.641095 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-2c23a42a-a125-4b67-92eb-2fe4aacc495d tempest-VolumesGetTest-171462808 None] Created reservations ['877700f0-93dc-4b61-a3e0-a755dc1c87d3', '842bb6e7-40ef-4f38-a3a7-020c071e7a3a', 'a9c194da-343c-4030-aa13-577dd379e4a1', '0b3a6b3b-9244-4dd8-92be-c282c9dc9cf0'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:57:06.863866 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2c23a42a-a125-4b67-92eb-2fe4aacc495d tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:06.901677 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2c23a42a-a125-4b67-92eb-2fe4aacc495d tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:06.926001 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-2c23a42a-a125-4b67-92eb-2fe4aacc495d tempest-VolumesGetTest-171462808 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:57:06.930980 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2c23a42a-a125-4b67-92eb-2fe4aacc495d tempest-VolumesGetTest-171462808 None] Deleted volume successfully. May 02 10:57:06.993730 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-2c23a42a-a125-4b67-92eb-2fe4aacc495d tempest-VolumesGetTest-171462808 None] Lock "b'cinder-db851d4d-3c84-4207-a9d0-dd0544cb0dcc-delete_volume'" released by "delete_volume" :: held 6.921s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:57:08.041751 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:57:08.063607 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (ce052af5-619a-41e3-ac50-924a82b7ca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:08.070344 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e549a93-feda-4ca9-b9bd-e8e4d1ed1342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:08.106021 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e549a93-feda-4ca9-b9bd-e8e4d1ed1342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-986227349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e032465f-fe9b-41c8-af99-bf7f0d244ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2414cc78d8648ed91a1527ecf826bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:57:08Z,use_quota=True,user_id='1cfbc4371862424ab7c6ff88c6fc009d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:08.112079 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f0a588-3fd4-4b22-a566-d40d0aff70e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:08.116313 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f0a588-3fd4-4b22-a566-d40d0aff70e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:08.124926 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ea6914-79b6-47df-ac47-1be7f9be6317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:08.129131 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ea6914-79b6-47df-ac47-1be7f9be6317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e032465f-fe9b-41c8-af99-bf7f0d244ec8', 'volume_name': 'volume-e032465f-fe9b-41c8-af99-bf7f0d244ec8', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:08.134176 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451da395-c3fe-4034-b78d-96851af1e916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:08.138153 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451da395-c3fe-4034-b78d-96851af1e916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:08.143277 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5b6700-e9df-4ee2-857c-1d8dc4783391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:08.144352 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Volume e032465f-fe9b-41c8-af99-bf7f0d244ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e032465f-fe9b-41c8-af99-bf7f0d244ec8', 'volume_size': 1} May 02 10:57:08.144779 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] creating volume 'volume-e032465f-fe9b-41c8-af99-bf7f0d244ec8' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:57:08.145569 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:08.952001 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:57:08.953057 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:57:08.956860 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5b6700-e9df-4ee2-857c-1d8dc4783391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e032465f-fe9b-41c8-af99-bf7f0d244ec8', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:08.961591 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3996076-d76d-4fa7-8262-24535c263773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:09.023777 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Volume volume-e032465f-fe9b-41c8-af99-bf7f0d244ec8 (e032465f-fe9b-41c8-af99-bf7f0d244ec8): created successfully May 02 10:57:09.027498 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3996076-d76d-4fa7-8262-24535c263773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:09.033208 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (ce052af5-619a-41e3-ac50-924a82b7ca6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:09.178305 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-67cb2962-37ca-4f88-9e03-1e7ff3e9abbf tempest-VolumesGetTest-171462808 None] Created volume successfully. May 02 10:57:10.698367 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:57:10.725780 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (4f886d5f-6281-4d65-b5e0-94ccb3486bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:10.732188 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e302c51c-cc20-404c-97e2-a470c0a03526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:10.736242 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] Created reservations ['491ed8c2-b4a3-4eaa-941b-d02efc0183e5'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:57:10.748487 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e302c51c-cc20-404c-97e2-a470c0a03526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1640198597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f1fb13e2-16cc-4dc5-be18-45d4ded007b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2414cc78d8648ed91a1527ecf826bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e032465f-fe9b-41c8-af99-bf7f0d244ec8,status='creating',terminated_at=None,updated_at=2022-05-02T10:57:11Z,use_quota=True,user_id='1cfbc4371862424ab7c6ff88c6fc009d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:10.754384 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b013db5a-3f42-4bab-bfe6-5198ece99eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:10.758524 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b013db5a-3f42-4bab-bfe6-5198ece99eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:10.763675 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb4f3de-e6f9-4874-8712-0ba8f6f93f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:10.782657 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb4f3de-e6f9-4874-8712-0ba8f6f93f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f1fb13e2-16cc-4dc5-be18-45d4ded007b2', 'volume_name': 'volume-f1fb13e2-16cc-4dc5-be18-45d4ded007b2', 'volume_size': 1, 'source_volid': 'e032465f-fe9b-41c8-af99-bf7f0d244ec8', 'source_volstatus': 'available'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:10.787771 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f414ae7e-4440-4011-8c1d-839860d80992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:10.791798 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f414ae7e-4440-4011-8c1d-839860d80992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:10.796669 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de441b6-fec1-4356-80b4-a75bbcb5cd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:10.798262 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Volume f1fb13e2-16cc-4dc5-be18-45d4ded007b2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f1fb13e2-16cc-4dc5-be18-45d4ded007b2', 'volume_size': 1, 'source_volid': 'e032465f-fe9b-41c8-af99-bf7f0d244ec8', 'source_volstatus': 'available'} May 02 10:57:10.810659 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:10.972143 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] creating snapshot='volume-f1fb13e2-16cc-4dc5-be18-45d4ded007b2.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:57:12.053043 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] cloning 'volume-e032465f-fe9b-41c8-af99-bf7f0d244ec8@volume-f1fb13e2-16cc-4dc5-be18-45d4ded007b2.clone_snap' to 'volume-f1fb13e2-16cc-4dc5-be18-45d4ded007b2' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:57:12.061554 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-405329176 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-405329176, it is now deprecated. Please use the default quota class for default quota. May 02 10:57:12.121493 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] Created reservations ['d6bd6253-eb7e-4fb6-a322-8f2c81ed6ee5', 'f892f95c-39e4-46c7-ae4e-627f29739c59', '6a18fc54-76e5-4437-b85b-a7415d84b643', '57b93584-01f9-4cb5-ab03-86b9e6a96135'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:57:12.413060 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] Created reservations ['b08343d3-1541-4d3d-908a-23e3e1f17ad3', '961ee3de-6feb-43b9-a722-98de766b101a', 'a398069c-9f56-405c-8e40-ab96ca861a62', '3e5da46f-49e0-4feb-840f-f660a175bbd7'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:57:12.815983 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:12.837399 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:12.860634 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:57:12.864809 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-de32b027-48b0-4157-9bb2-971cd44540fa tempest-GroupSnapshotsTest-206173987 None] Delete group completed successfully. May 02 10:57:13.122539 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Volume volume-e032465f-fe9b-41c8-af99-bf7f0d244ec8 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:57:13.123821 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:57:13.124312 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:57:13.370239 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:57:13.374036 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de441b6-fec1-4356-80b4-a75bbcb5cd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1fb13e2-16cc-4dc5-be18-45d4ded007b2', 'volume_size': 1, 'source_volid': 'e032465f-fe9b-41c8-af99-bf7f0d244ec8', 'source_volstatus': 'available'}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:13.379249 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d52f2cc-461f-4c62-a8c4-7eedee85b681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:13.458064 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Volume volume-f1fb13e2-16cc-4dc5-be18-45d4ded007b2 (f1fb13e2-16cc-4dc5-be18-45d4ded007b2): created successfully May 02 10:57:13.461779 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d52f2cc-461f-4c62-a8c4-7eedee85b681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:13.467572 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (4f886d5f-6281-4d65-b5e0-94ccb3486bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:13.549875 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2b68ef69-5dd3-4229-bab5-5375ec82835e tempest-VolumesGetTest-171462808 None] Created volume successfully. May 02 10:57:14.438588 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4e2feeac-a83d-4d7e-85b1-0335ffb6337e tempest-GroupSnapshotsTest-206173987 None] Group tempest-GroupSnapshotsTest-Group-1250433091: creating May 02 10:57:14.496897 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4e2feeac-a83d-4d7e-85b1-0335ffb6337e tempest-GroupSnapshotsTest-206173987 None] Group tempest-GroupSnapshotsTest-Group-1250433091: created successfully May 02 10:57:14.505785 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4e2feeac-a83d-4d7e-85b1-0335ffb6337e tempest-GroupSnapshotsTest-206173987 None] Create group completed successfully. May 02 10:57:14.669659 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:57:14.690223 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (0983136e-6f46-4924-9fb4-de05017837cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:14.696696 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e827d0d2-9ad4-4085-aac6-a33073e23447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:14.711727 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e827d0d2-9ad4-4085-aac6-a33073e23447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:57:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-247805025',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=36986db4-0785-49ec-95e9-0e664776d2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2414cc78d8648ed91a1527ecf826bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:57:14Z,use_quota=True,user_id='1cfbc4371862424ab7c6ff88c6fc009d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:14.717190 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467ea223-4a42-4c3d-91d1-9e8989537d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:14.722020 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467ea223-4a42-4c3d-91d1-9e8989537d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:14.727212 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730f69f9-aca0-4679-95dc-d2bebd28f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:14.731331 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730f69f9-aca0-4679-95dc-d2bebd28f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36986db4-0785-49ec-95e9-0e664776d2fd', 'volume_name': 'volume-36986db4-0785-49ec-95e9-0e664776d2fd', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:14.736401 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e76ff3b-6a38-4efa-ba4c-6d92ad0c8ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:14.740386 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e76ff3b-6a38-4efa-ba4c-6d92ad0c8ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:14.745294 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b70c72c-6b12-4ebc-9d4c-57adc52fd5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:14.746385 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Volume 36986db4-0785-49ec-95e9-0e664776d2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36986db4-0785-49ec-95e9-0e664776d2fd', 'volume_size': 1} May 02 10:57:14.746774 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] creating volume 'volume-36986db4-0785-49ec-95e9-0e664776d2fd' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:57:14.747533 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:15.174244 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:57:15.174637 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:57:15.178718 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b70c72c-6b12-4ebc-9d4c-57adc52fd5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36986db4-0785-49ec-95e9-0e664776d2fd', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:15.183511 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81998e79-4fea-46ca-944f-53750012a029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:15.281143 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Volume volume-36986db4-0785-49ec-95e9-0e664776d2fd (36986db4-0785-49ec-95e9-0e664776d2fd): created successfully May 02 10:57:15.284866 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81998e79-4fea-46ca-944f-53750012a029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:15.290558 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (0983136e-6f46-4924-9fb4-de05017837cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:15.361616 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-73860e55-3d00-47b7-b8e6-659c7195f45c tempest-VolumesGetTest-171462808 None] Created volume successfully. May 02 10:57:15.752258 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-2b7c3cb4-e89d-4765-96cc-75d98774b6e9 tempest-VolumesGetTest-171462808 None] Lock "b'cinder-36986db4-0785-49ec-95e9-0e664776d2fd-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:57:15.839756 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b7c3cb4-e89d-4765-96cc-75d98774b6e9 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:15.995081 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b7c3cb4-e89d-4765-96cc-75d98774b6e9 tempest-VolumesGetTest-171462808 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:57:15.995403 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b7c3cb4-e89d-4765-96cc-75d98774b6e9 tempest-VolumesGetTest-171462808 None] Volume volume-36986db4-0785-49ec-95e9-0e664776d2fd is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:57:16.058853 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b7c3cb4-e89d-4765-96cc-75d98774b6e9 tempest-VolumesGetTest-171462808 None] deleting rbd volume volume-36986db4-0785-49ec-95e9-0e664776d2fd {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:57:16.270263 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:57:16.289812 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Flow 'volume_create_manager' (e51ba70c-3c86-48bd-9df9-5ca2886ac8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:16.296333 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3030dfd8-c0e3-4707-8324-9f3387380e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:16.311151 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3030dfd8-c0e3-4707-8324-9f3387380e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-264165180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85e7f7ef-fe7d-4465-bf1d-425f946a43f6,host='ncdv-master-1@ceph#ceph',id=a47bfe2d-18a5-48f9-8a16-d98f446445be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5579201e7ef47d0a5f56c4c0cff6612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:57:16Z,use_quota=True,user_id='cab0b88500b7427ca47c70559236f8e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11f264e6-3872-4617-954d-ef2839b81817),volume_type_id=11f264e6-3872-4617-954d-ef2839b81817)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:16.316635 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d866d0b-18e0-4eaa-956d-882b5300efe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:16.320757 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d866d0b-18e0-4eaa-956d-882b5300efe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:16.326179 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb23fe85-70f6-4059-bd71-de545a7565c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:16.330876 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb23fe85-70f6-4059-bd71-de545a7565c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a47bfe2d-18a5-48f9-8a16-d98f446445be', 'volume_name': 'volume-a47bfe2d-18a5-48f9-8a16-d98f446445be', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:16.335852 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5619a2d5-4a6d-4d02-8961-f972fc3cd6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:16.339761 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5619a2d5-4a6d-4d02-8961-f972fc3cd6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:16.344503 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9976b181-522c-4165-9399-f7490d63363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:16.346241 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Volume a47bfe2d-18a5-48f9-8a16-d98f446445be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a47bfe2d-18a5-48f9-8a16-d98f446445be', 'volume_size': 1} May 02 10:57:16.346629 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] creating volume 'volume-a47bfe2d-18a5-48f9-8a16-d98f446445be' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:57:16.347284 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:17.305939 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] extra_specs: {} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:57:17.306624 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] extra_specs: {} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:57:17.310155 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9976b181-522c-4165-9399-f7490d63363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a47bfe2d-18a5-48f9-8a16-d98f446445be', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:17.314988 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec5c02b-79ca-4810-9141-bd96dd46b484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:17.372703 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Volume volume-a47bfe2d-18a5-48f9-8a16-d98f446445be (a47bfe2d-18a5-48f9-8a16-d98f446445be): created successfully May 02 10:57:17.376301 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec5c02b-79ca-4810-9141-bd96dd46b484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:17.381839 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Flow 'volume_create_manager' (e51ba70c-3c86-48bd-9df9-5ca2886ac8db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:17.441075 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-004e09df-b404-4ef0-b3d6-4330038147d5 tempest-GroupSnapshotsTest-206173987 None] Created volume successfully. May 02 10:57:18.610605 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b3a8ae57-dda3-484c-8f1d-4b16bbbcca0b tempest-GroupSnapshotsTest-206173987 None] GroupSnapshot 5f12053b-456c-4dae-a9b7-44983f2b65fc: creating. May 02 10:57:18.632342 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-b3a8ae57-dda3-484c-8f1d-4b16bbbcca0b tempest-GroupSnapshotsTest-206173987 None] Group snapshot 5f12053b-456c-4dae-a9b7-44983f2b65fc: creating. {{(pid=123784) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} May 02 10:57:18.641915 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-b3a8ae57-dda3-484c-8f1d-4b16bbbcca0b tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:20.618014 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-2b7c3cb4-e89d-4765-96cc-75d98774b6e9 tempest-VolumesGetTest-171462808 None] Created reservations ['bb104097-9a47-4714-a421-5b032ad1731f', '3f494c9e-6387-435e-87e8-116f3ff70a74', '7c634f04-5bff-4d98-af95-2a7b1b5e5777', '3de0d6f4-0cc1-4372-8e08-acd308a945cc'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:57:20.755692 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b7c3cb4-e89d-4765-96cc-75d98774b6e9 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:20.778111 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-2b7c3cb4-e89d-4765-96cc-75d98774b6e9 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:20.801322 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-2b7c3cb4-e89d-4765-96cc-75d98774b6e9 tempest-VolumesGetTest-171462808 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:57:20.805344 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-2b7c3cb4-e89d-4765-96cc-75d98774b6e9 tempest-VolumesGetTest-171462808 None] Deleted volume successfully. May 02 10:57:20.895960 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-2b7c3cb4-e89d-4765-96cc-75d98774b6e9 tempest-VolumesGetTest-171462808 None] Lock "b'cinder-36986db4-0785-49ec-95e9-0e664776d2fd-delete_volume'" released by "delete_volume" :: held 5.144s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:57:21.126169 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-b3a8ae57-dda3-484c-8f1d-4b16bbbcca0b tempest-GroupSnapshotsTest-206173987 None] group_snapshot 5f12053b-456c-4dae-a9b7-44983f2b65fc: created successfully May 02 10:57:21.187160 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] Lock "b'cinder-f1fb13e2-16cc-4dc5-be18-45d4ded007b2-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:57:21.266375 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:21.399397 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:57:21.509216 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] deleting rbd volume volume-f1fb13e2-16cc-4dc5-be18-45d4ded007b2 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:57:22.018835 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f596a6f4-bf5b-45f7-8796-821fa9844dad tempest-GroupSnapshotsTest-206173987 None] group_snapshot 5f12053b-456c-4dae-a9b7-44983f2b65fc: deleting May 02 10:57:22.034915 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-f596a6f4-bf5b-45f7-8796-821fa9844dad tempest-GroupSnapshotsTest-206173987 None] group_snapshot 5f12053b-456c-4dae-a9b7-44983f2b65fc: deleting {{(pid=123784) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} May 02 10:57:22.050060 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f596a6f4-bf5b-45f7-8796-821fa9844dad tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:25.754842 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-f596a6f4-bf5b-45f7-8796-821fa9844dad tempest-GroupSnapshotsTest-206173987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-902780321 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-902780321, it is now deprecated. Please use the default quota class for default quota. May 02 10:57:25.755562 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-f596a6f4-bf5b-45f7-8796-821fa9844dad tempest-GroupSnapshotsTest-206173987 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-902780321 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-902780321, it is now deprecated. Please use the default quota class for default quota. May 02 10:57:25.817820 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:57:25.949863 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] Volume volume-e032465f-fe9b-41c8-af99-bf7f0d244ec8 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:57:25.950613 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] deleting parent snapshot volume-f1fb13e2-16cc-4dc5-be18-45d4ded007b2.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:57:27.814884 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-f596a6f4-bf5b-45f7-8796-821fa9844dad tempest-GroupSnapshotsTest-206173987 None] Created reservations ['a03daf56-0b79-4b86-aad2-46754900cba4', '9c6d9c21-82a5-4811-8717-8f3638c7c820', '38fbdcf7-61a0-4a06-b0a0-01a94d326ebf', 'bc4b1cf6-2f0c-4a5a-8fa6-a8876f259335'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:57:27.957341 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] Created reservations ['98534ea7-7dd1-406f-8169-0d4118433081', '3c13e348-49cb-40bb-a234-ac27a8e06456', '1e110570-0af5-4380-bec2-ebbffc42996f', '5d42d50d-e2e0-49d3-8fdb-d9968da90a54'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:57:28.149908 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f596a6f4-bf5b-45f7-8796-821fa9844dad tempest-GroupSnapshotsTest-206173987 None] group_snapshot 5f12053b-456c-4dae-a9b7-44983f2b65fc: deleted successfully May 02 10:57:28.161357 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:28.228928 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:28.251304 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:57:28.261105 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] Deleted volume successfully. May 02 10:57:28.335898 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-6cec1be0-5d96-4bc5-b94f-ac2382c19755 tempest-VolumesGetTest-171462808 None] Lock "b'cinder-f1fb13e2-16cc-4dc5-be18-45d4ded007b2-delete_volume'" released by "delete_volume" :: held 7.149s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:57:28.696355 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ffe7a49-7370-4b0d-beea-2efd6598db7f tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:28.829329 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ffe7a49-7370-4b0d-beea-2efd6598db7f tempest-GroupSnapshotsTest-206173987 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:57:28.829976 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ffe7a49-7370-4b0d-beea-2efd6598db7f tempest-GroupSnapshotsTest-206173987 None] Volume volume-a47bfe2d-18a5-48f9-8a16-d98f446445be is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:57:28.910047 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ffe7a49-7370-4b0d-beea-2efd6598db7f tempest-GroupSnapshotsTest-206173987 None] deleting rbd volume volume-a47bfe2d-18a5-48f9-8a16-d98f446445be {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:57:29.363507 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:57:29.383641 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (7901ae7c-7496-4799-8adf-f51091e80f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:29.390193 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f037584-f671-410b-a810-f5176a7769ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:29.406422 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f037584-f671-410b-a810-f5176a7769ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1040517723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a31dcd89-ae06-4243-baf3-80fe5b6ab567,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2414cc78d8648ed91a1527ecf826bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:57:29Z,use_quota=True,user_id='1cfbc4371862424ab7c6ff88c6fc009d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:29.412780 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb343e39-1eaf-473a-b52c-a072b58bad7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:29.416933 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb343e39-1eaf-473a-b52c-a072b58bad7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:29.422601 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f53cebe-ba38-458d-9434-cceeace5f3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:29.501271 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f53cebe-ba38-458d-9434-cceeace5f3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a31dcd89-ae06-4243-baf3-80fe5b6ab567', 'volume_name': 'volume-a31dcd89-ae06-4243-baf3-80fe5b6ab567', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:29.506353 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43171670-3adb-4328-bd05-a38372d177ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:29.510300 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43171670-3adb-4328-bd05-a38372d177ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:29.519793 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475e14f5-da6e-4d29-88c6-b22872aa5b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:29.519793 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Volume a31dcd89-ae06-4243-baf3-80fe5b6ab567: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a31dcd89-ae06-4243-baf3-80fe5b6ab567', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 10:57:29.519793 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Cloning a31dcd89-ae06-4243-baf3-80fe5b6ab567 from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 10:57:29.525353 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:57:29.595523 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 57, 29, 529226)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:57:29.596617 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:57:29.597043 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 10:57:29.601209 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.076s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:57:29.605876 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 10:57:29.608029 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 10, 57, 29, 605650)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 10:57:29.608449 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 10:57:29.608872 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 10:57:29.619908 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:29.755138 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] creating snapshot='volume-a31dcd89-ae06-4243-baf3-80fe5b6ab567.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 10:57:31.880587 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-a31dcd89-ae06-4243-baf3-80fe5b6ab567.clone_snap' to 'volume-a31dcd89-ae06-4243-baf3-80fe5b6ab567' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 10:57:33.833600 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:57:33.835073 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:57:33.835455 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:57:34.210171 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 10:57:34.210784 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Marking volume a31dcd89-ae06-4243-baf3-80fe5b6ab567 as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 10:57:34.286264 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to a31dcd89-ae06-4243-baf3-80fe5b6ab567. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 10:57:34.286673 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Creating volume glance metadata for volume a31dcd89-ae06-4243-baf3-80fe5b6ab567 backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 10:57:34.316929 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-1ffe7a49-7370-4b0d-beea-2efd6598db7f tempest-GroupSnapshotsTest-206173987 None] Created reservations ['0a65856c-8ec5-4392-a45e-0a75147036dd'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:57:34.342013 ncdv-master-1 cinder-volume[123784]: WARNING cinder.quota [None req-1ffe7a49-7370-4b0d-beea-2efd6598db7f tempest-GroupSnapshotsTest-206173987 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-902780321 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-902780321, it is now deprecated. Please use the default quota class for default quota. May 02 10:57:34.394185 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475e14f5-da6e-4d29-88c6-b22872aa5b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31dcd89-ae06-4243-baf3-80fe5b6ab567', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:34.399067 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258e7d4a-03c8-4545-8746-43dc976237e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:34.411713 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-1ffe7a49-7370-4b0d-beea-2efd6598db7f tempest-GroupSnapshotsTest-206173987 None] Created reservations ['f904b297-eb25-4247-814f-00274ab4d939', 'ee302c44-6b57-4b02-99c2-ead681bdc571', '6ba1947e-80b1-4552-ae6c-3e33417c11b9', '0f9a8b45-c2fa-4ad9-bea0-dca30e3eb371'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:57:34.446211 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Volume volume-a31dcd89-ae06-4243-baf3-80fe5b6ab567 (a31dcd89-ae06-4243-baf3-80fe5b6ab567): created successfully May 02 10:57:34.449852 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258e7d4a-03c8-4545-8746-43dc976237e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:34.455977 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (7901ae7c-7496-4799-8adf-f51091e80f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:34.514949 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-92e72d0d-c322-43e5-8bfd-f1caf3f0cd4e tempest-VolumesGetTest-171462808 None] Created volume successfully. May 02 10:57:34.677402 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ffe7a49-7370-4b0d-beea-2efd6598db7f tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:34.700246 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-1ffe7a49-7370-4b0d-beea-2efd6598db7f tempest-GroupSnapshotsTest-206173987 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:34.723166 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-1ffe7a49-7370-4b0d-beea-2efd6598db7f tempest-GroupSnapshotsTest-206173987 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:57:34.726955 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-1ffe7a49-7370-4b0d-beea-2efd6598db7f tempest-GroupSnapshotsTest-206173987 None] Delete group completed successfully. May 02 10:57:36.505665 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:57:36.525512 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (11fdbe4e-6963-4d33-8518-eb1f86ed8608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:36.532054 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e32a87-d978-41f9-a945-4a0eb1feec8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:36.547373 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e32a87-d978-41f9-a945-4a0eb1feec8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:57:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1381232812',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f9c2602-aa76-4ca5-ac3b-ec3873ef773f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2414cc78d8648ed91a1527ecf826bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:57:36Z,use_quota=True,user_id='1cfbc4371862424ab7c6ff88c6fc009d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:36.553505 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b909402-dac7-4097-940e-84c4614c54b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:36.557832 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b909402-dac7-4097-940e-84c4614c54b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:36.563134 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e790e9-3666-4fd0-94d3-5996fd1727e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:36.567990 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e790e9-3666-4fd0-94d3-5996fd1727e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f9c2602-aa76-4ca5-ac3b-ec3873ef773f', 'volume_name': 'volume-4f9c2602-aa76-4ca5-ac3b-ec3873ef773f', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:36.573259 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d98d253-ccf0-4bdd-8cac-8c8ebdacfc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:36.577319 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d98d253-ccf0-4bdd-8cac-8c8ebdacfc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:36.582299 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44cd52b-7a2c-4ae0-9ce6-f7fc90af48b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:36.583429 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Volume 4f9c2602-aa76-4ca5-ac3b-ec3873ef773f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f9c2602-aa76-4ca5-ac3b-ec3873ef773f', 'volume_size': 1} May 02 10:57:36.583849 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] creating volume 'volume-4f9c2602-aa76-4ca5-ac3b-ec3873ef773f' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:57:36.584675 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:37.170201 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:57:37.170673 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:57:37.174629 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44cd52b-7a2c-4ae0-9ce6-f7fc90af48b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f9c2602-aa76-4ca5-ac3b-ec3873ef773f', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:37.179412 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164bc9e1-9873-4dd9-ae75-2f791b930a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:37.258409 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Volume volume-4f9c2602-aa76-4ca5-ac3b-ec3873ef773f (4f9c2602-aa76-4ca5-ac3b-ec3873ef773f): created successfully May 02 10:57:37.263461 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164bc9e1-9873-4dd9-ae75-2f791b930a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:37.270391 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Flow 'volume_create_manager' (11fdbe4e-6963-4d33-8518-eb1f86ed8608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:37.371582 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-e52b607f-ab27-4cd3-927a-afeb8a97e91a tempest-VolumesGetTest-171462808 None] Created volume successfully. May 02 10:57:37.688265 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-022c76da-caf2-4f04-976c-24df5f8eec8f tempest-VolumesGetTest-171462808 None] Lock "b'cinder-4f9c2602-aa76-4ca5-ac3b-ec3873ef773f-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:57:37.789607 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-022c76da-caf2-4f04-976c-24df5f8eec8f tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:38.029102 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-022c76da-caf2-4f04-976c-24df5f8eec8f tempest-VolumesGetTest-171462808 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:57:38.029467 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-022c76da-caf2-4f04-976c-24df5f8eec8f tempest-VolumesGetTest-171462808 None] Volume volume-4f9c2602-aa76-4ca5-ac3b-ec3873ef773f is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:57:38.166924 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-022c76da-caf2-4f04-976c-24df5f8eec8f tempest-VolumesGetTest-171462808 None] deleting rbd volume volume-4f9c2602-aa76-4ca5-ac3b-ec3873ef773f {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:57:42.036405 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-022c76da-caf2-4f04-976c-24df5f8eec8f tempest-VolumesGetTest-171462808 None] Created reservations ['0cebdf94-491d-473e-bdc3-be15e89957c4', '17f66036-7347-4e5b-91c2-9cd3ce4397a6', 'b744a702-e654-4e80-bc9f-bc7e7f87d1d8', 'facb5a93-cb79-4880-800a-26490c5a43b4'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:57:42.201583 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-022c76da-caf2-4f04-976c-24df5f8eec8f tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:42.226062 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-022c76da-caf2-4f04-976c-24df5f8eec8f tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:42.312408 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-022c76da-caf2-4f04-976c-24df5f8eec8f tempest-VolumesGetTest-171462808 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:57:42.318381 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-022c76da-caf2-4f04-976c-24df5f8eec8f tempest-VolumesGetTest-171462808 None] Deleted volume successfully. May 02 10:57:42.387376 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-022c76da-caf2-4f04-976c-24df5f8eec8f tempest-VolumesGetTest-171462808 None] Lock "b'cinder-4f9c2602-aa76-4ca5-ac3b-ec3873ef773f-delete_volume'" released by "delete_volume" :: held 4.700s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:57:43.139799 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-fcc3e6f6-b478-435d-9a76-a5d31aaf8b49 tempest-VolumesGetTest-171462808 None] Lock "b'cinder-a31dcd89-ae06-4243-baf3-80fe5b6ab567-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:57:43.202329 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fcc3e6f6-b478-435d-9a76-a5d31aaf8b49 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:43.348710 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fcc3e6f6-b478-435d-9a76-a5d31aaf8b49 tempest-VolumesGetTest-171462808 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:57:43.435699 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fcc3e6f6-b478-435d-9a76-a5d31aaf8b49 tempest-VolumesGetTest-171462808 None] deleting rbd volume volume-a31dcd89-ae06-4243-baf3-80fe5b6ab567 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:57:46.795205 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fcc3e6f6-b478-435d-9a76-a5d31aaf8b49 tempest-VolumesGetTest-171462808 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 10:57:47.064946 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fcc3e6f6-b478-435d-9a76-a5d31aaf8b49 tempest-VolumesGetTest-171462808 None] deleting parent snapshot volume-a31dcd89-ae06-4243-baf3-80fe5b6ab567.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 10:57:49.738155 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-fcc3e6f6-b478-435d-9a76-a5d31aaf8b49 tempest-VolumesGetTest-171462808 None] Created reservations ['2ad159f3-c46d-442a-8133-ccd172bfcebf', '3a76aaed-26fc-4f24-8a6a-a9b9fbf2504a', '106eefbf-224b-442e-ad3f-3d3538a86207', '8561d88f-8c47-4d0a-939e-f19f12491407'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:57:49.897844 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fcc3e6f6-b478-435d-9a76-a5d31aaf8b49 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:49.957153 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-fcc3e6f6-b478-435d-9a76-a5d31aaf8b49 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:50.040497 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-fcc3e6f6-b478-435d-9a76-a5d31aaf8b49 tempest-VolumesGetTest-171462808 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:57:50.045759 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-fcc3e6f6-b478-435d-9a76-a5d31aaf8b49 tempest-VolumesGetTest-171462808 None] Deleted volume successfully. May 02 10:57:50.147552 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-fcc3e6f6-b478-435d-9a76-a5d31aaf8b49 tempest-VolumesGetTest-171462808 None] Lock "b'cinder-a31dcd89-ae06-4243-baf3-80fe5b6ab567-delete_volume'" released by "delete_volume" :: held 7.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:57:50.761014 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-3ca10ef4-d111-4627-b69d-43d01de311d2 tempest-VolumesGetTest-171462808 None] Lock "b'cinder-e032465f-fe9b-41c8-af99-bf7f0d244ec8-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:57:50.863083 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3ca10ef4-d111-4627-b69d-43d01de311d2 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:51.015770 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3ca10ef4-d111-4627-b69d-43d01de311d2 tempest-VolumesGetTest-171462808 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:57:51.015770 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3ca10ef4-d111-4627-b69d-43d01de311d2 tempest-VolumesGetTest-171462808 None] Volume volume-e032465f-fe9b-41c8-af99-bf7f0d244ec8 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:57:51.154083 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3ca10ef4-d111-4627-b69d-43d01de311d2 tempest-VolumesGetTest-171462808 None] deleting rbd volume volume-e032465f-fe9b-41c8-af99-bf7f0d244ec8 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:57:52.150025 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 10:57:52.268514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Flow 'volume_create_manager' (3bdda1f9-cb6f-420e-a98f-5f374609e0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:52.268514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca254e6-345f-4001-8eaf-278e0301c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:52.268514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca254e6-345f-4001-8eaf-278e0301c404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T10:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2026895964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd728d27-3ddd-4655-933b-935db58a7f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c467c5de099441b939ec93e1c773441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T10:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T10:57:52Z,use_quota=True,user_id='c3998993aeaa4739ac9e0cb2fa4e28a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:52.268514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d9e8c0-c2b8-493d-a3e1-28fbf68e3259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:52.268514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d9e8c0-c2b8-493d-a3e1-28fbf68e3259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:52.268514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c548ba-04cd-461d-9f33-1d88f4102af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:52.268514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c548ba-04cd-461d-9f33-1d88f4102af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd728d27-3ddd-4655-933b-935db58a7f33', 'volume_name': 'volume-cd728d27-3ddd-4655-933b-935db58a7f33', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:52.268514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76978f8f-f610-4d56-9542-79cc605d6d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:52.269309 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76978f8f-f610-4d56-9542-79cc605d6d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:52.269309 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2fdeafe-a941-410e-91c3-0bb2548a7b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:52.269309 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Volume cd728d27-3ddd-4655-933b-935db58a7f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd728d27-3ddd-4655-933b-935db58a7f33', 'volume_size': 1} May 02 10:57:52.269309 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] creating volume 'volume-cd728d27-3ddd-4655-933b-935db58a7f33' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 10:57:52.269309 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:53.100496 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 10:57:53.100940 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 10:57:53.105388 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2fdeafe-a941-410e-91c3-0bb2548a7b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd728d27-3ddd-4655-933b-935db58a7f33', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:53.121187 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1272e689-7bad-4155-9f93-76be8c29b8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 10:57:53.281460 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Volume volume-cd728d27-3ddd-4655-933b-935db58a7f33 (cd728d27-3ddd-4655-933b-935db58a7f33): created successfully May 02 10:57:53.285351 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1272e689-7bad-4155-9f93-76be8c29b8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 10:57:53.291666 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Flow 'volume_create_manager' (3bdda1f9-cb6f-420e-a98f-5f374609e0f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 10:57:53.372618 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-59f13133-f03d-4798-8249-c11b53bb2874 tempest-VolumesActionsTest-1221822112 None] Created volume successfully. May 02 10:57:54.841531 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-3ca10ef4-d111-4627-b69d-43d01de311d2 tempest-VolumesGetTest-171462808 None] Created reservations ['d9e3eeec-91cf-4ed0-b9e8-2d17e1254b9e', 'b6bb541b-7395-4a6e-add2-29964e3ac2f3', 'e18fb9b8-b5bf-4d5f-be02-9c96451be9f3', '75f47c39-97e5-49ce-9393-cbcc04d4df77'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:57:54.995568 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3ca10ef4-d111-4627-b69d-43d01de311d2 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:55.019932 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-3ca10ef4-d111-4627-b69d-43d01de311d2 tempest-VolumesGetTest-171462808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:57:55.045943 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-3ca10ef4-d111-4627-b69d-43d01de311d2 tempest-VolumesGetTest-171462808 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:57:55.050788 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-3ca10ef4-d111-4627-b69d-43d01de311d2 tempest-VolumesGetTest-171462808 None] Deleted volume successfully. May 02 10:57:55.165461 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-3ca10ef4-d111-4627-b69d-43d01de311d2 tempest-VolumesGetTest-171462808 None] Lock "b'cinder-e032465f-fe9b-41c8-af99-bf7f0d244ec8-delete_volume'" released by "delete_volume" :: held 4.376s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:58:00.802464 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:58:00.803233 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:58:00.830452 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:58:00.857395 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:58:06.782990 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-37d2d023-0f89-48fb-9ab3-9b42aff98cfc tempest-VolumesActionsTest-1221822112 None] Lock "b'cinder-cd728d27-3ddd-4655-933b-935db58a7f33'" acquired by "attach_volume" :: waited 0.013s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:58:06.974200 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-37d2d023-0f89-48fb-9ab3-9b42aff98cfc tempest-VolumesActionsTest-1221822112 None] Attaching volume cd728d27-3ddd-4655-933b-935db58a7f33 to instance 644c1b06-f239-42a2-b941-1694f297332b at mountpoint /dev/sdb on host None. May 02 10:58:07.087771 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-37d2d023-0f89-48fb-9ab3-9b42aff98cfc tempest-VolumesActionsTest-1221822112 None] Attach volume completed successfully. May 02 10:58:07.094147 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-37d2d023-0f89-48fb-9ab3-9b42aff98cfc tempest-VolumesActionsTest-1221822112 None] Lock "b'cinder-cd728d27-3ddd-4655-933b-935db58a7f33'" released by "attach_volume" :: held 0.311s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:58:07.223639 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-635b4274-c662-4bb3-a907-d8173144bb6b tempest-VolumesActionsTest-1221822112 None] Lock "b'cinder-cd728d27-3ddd-4655-933b-935db58a7f33-detach_volume'" acquired by "detach_volume" :: waited 0.017s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:58:07.225607 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-635b4274-c662-4bb3-a907-d8173144bb6b tempest-VolumesActionsTest-1221822112 None] Detaching volume cd728d27-3ddd-4655-933b-935db58a7f33 from instance 644c1b06-f239-42a2-b941-1694f297332b. May 02 10:58:07.403334 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-635b4274-c662-4bb3-a907-d8173144bb6b tempest-VolumesActionsTest-1221822112 None] Detach volume completed successfully. May 02 10:58:07.409182 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-635b4274-c662-4bb3-a907-d8173144bb6b tempest-VolumesActionsTest-1221822112 None] Lock "b'cinder-cd728d27-3ddd-4655-933b-935db58a7f33-detach_volume'" released by "detach_volume" :: held 0.186s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:58:23.946451 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-6b4050dc-6b79-45f2-80e7-01a08b04938b tempest-VolumesActionsTest-1221822112 None] Lock "b'cinder-cd728d27-3ddd-4655-933b-935db58a7f33'" acquired by "attach_volume" :: waited 0.011s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:58:24.132771 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-6b4050dc-6b79-45f2-80e7-01a08b04938b tempest-VolumesActionsTest-1221822112 None] Attaching volume cd728d27-3ddd-4655-933b-935db58a7f33 to instance f78b618d-894f-42fa-85fd-58c0a57c9c0c at mountpoint /dev/sdb on host None. May 02 10:58:24.207272 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-6b4050dc-6b79-45f2-80e7-01a08b04938b tempest-VolumesActionsTest-1221822112 None] Attach volume completed successfully. May 02 10:58:24.211627 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-6b4050dc-6b79-45f2-80e7-01a08b04938b tempest-VolumesActionsTest-1221822112 None] Lock "b'cinder-cd728d27-3ddd-4655-933b-935db58a7f33'" released by "attach_volume" :: held 0.265s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:58:24.374513 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-fa64bf63-287f-4a6e-b083-7c99e6e6271f tempest-VolumesActionsTest-1221822112 None] Lock "b'cinder-cd728d27-3ddd-4655-933b-935db58a7f33-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:58:24.375000 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-fa64bf63-287f-4a6e-b083-7c99e6e6271f tempest-VolumesActionsTest-1221822112 None] Detaching volume cd728d27-3ddd-4655-933b-935db58a7f33 from instance f78b618d-894f-42fa-85fd-58c0a57c9c0c. May 02 10:58:24.532005 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-fa64bf63-287f-4a6e-b083-7c99e6e6271f tempest-VolumesActionsTest-1221822112 None] Detach volume completed successfully. May 02 10:58:24.539883 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-fa64bf63-287f-4a6e-b083-7c99e6e6271f tempest-VolumesActionsTest-1221822112 None] Lock "b'cinder-cd728d27-3ddd-4655-933b-935db58a7f33-detach_volume'" released by "detach_volume" :: held 0.165s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:58:29.608708 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-36694cc7-7772-484b-aa1b-6fa65f7c12c6 tempest-VolumesActionsTest-1221822112 None] Running cmd (subprocess): rbd export --pool volumes volume-cd728d27-3ddd-4655-933b-935db58a7f33 /opt/stack/data/cinder/conversion/volume-cd728d27-3ddd-4655-933b-935db58a7f33-2f6f5209-96c5-4316-8f99-b17504e91a0a --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 10:58:30.114531 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-36694cc7-7772-484b-aa1b-6fa65f7c12c6 tempest-VolumesActionsTest-1221822112 None] CMD "rbd export --pool volumes volume-cd728d27-3ddd-4655-933b-935db58a7f33 /opt/stack/data/cinder/conversion/volume-cd728d27-3ddd-4655-933b-935db58a7f33-2f6f5209-96c5-4316-8f99-b17504e91a0a --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.506s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 10:58:30.123155 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.image_utils [None req-36694cc7-7772-484b-aa1b-6fa65f7c12c6 tempest-VolumesActionsTest-1221822112 None] 2f6f5209-96c5-4316-8f99-b17504e91a0a was raw, no need to convert to raw {{(pid=123784) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} May 02 10:58:45.995950 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-36694cc7-7772-484b-aa1b-6fa65f7c12c6 tempest-VolumesActionsTest-1221822112 None] Uploaded volume to glance image-id: 2f6f5209-96c5-4316-8f99-b17504e91a0a. {{(pid=123784) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} May 02 10:58:46.091879 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-36694cc7-7772-484b-aa1b-6fa65f7c12c6 tempest-VolumesActionsTest-1221822112 None] Copy volume to image completed successfully. May 02 10:58:48.445809 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-499ad701-d6f2-4504-8e1b-b0d8c13370a9 tempest-VolumesActionsTest-1221822112 None] Lock "b'cinder-cd728d27-3ddd-4655-933b-935db58a7f33-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 10:58:48.517557 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-499ad701-d6f2-4504-8e1b-b0d8c13370a9 tempest-VolumesActionsTest-1221822112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:58:48.657612 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-499ad701-d6f2-4504-8e1b-b0d8c13370a9 tempest-VolumesActionsTest-1221822112 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 10:58:48.658095 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-499ad701-d6f2-4504-8e1b-b0d8c13370a9 tempest-VolumesActionsTest-1221822112 None] Volume volume-cd728d27-3ddd-4655-933b-935db58a7f33 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 10:58:48.789867 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-499ad701-d6f2-4504-8e1b-b0d8c13370a9 tempest-VolumesActionsTest-1221822112 None] deleting rbd volume volume-cd728d27-3ddd-4655-933b-935db58a7f33 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 10:58:51.748893 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-499ad701-d6f2-4504-8e1b-b0d8c13370a9 tempest-VolumesActionsTest-1221822112 None] Created reservations ['2618cb50-12f6-4f91-ae36-91cec1d66771', 'af439c97-9cd5-425a-9b55-4661d69260dd', '49ede6a4-3a1b-43dc-8711-eabbaf5096ab', '632049a5-9ab8-4d68-9354-dd1c9b4a76d9'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 10:58:51.875295 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-499ad701-d6f2-4504-8e1b-b0d8c13370a9 tempest-VolumesActionsTest-1221822112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:58:51.897527 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-499ad701-d6f2-4504-8e1b-b0d8c13370a9 tempest-VolumesActionsTest-1221822112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:58:51.920975 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-499ad701-d6f2-4504-8e1b-b0d8c13370a9 tempest-VolumesActionsTest-1221822112 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 10:58:51.925694 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-499ad701-d6f2-4504-8e1b-b0d8c13370a9 tempest-VolumesActionsTest-1221822112 None] Deleted volume successfully. May 02 10:58:52.009150 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-499ad701-d6f2-4504-8e1b-b0d8c13370a9 tempest-VolumesActionsTest-1221822112 None] Lock "b'cinder-cd728d27-3ddd-4655-933b-935db58a7f33-delete_volume'" released by "delete_volume" :: held 3.563s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 10:59:00.803316 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 10:59:00.804019 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:59:00.836206 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 10:59:00.876528 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:00:00.802037 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:00:00.802725 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:00:00.826977 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:00:00.853043 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:01:00.798793 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:01:00.799463 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:01:00.823710 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:01:00.851429 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:02:00.796976 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:02:00.797709 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:02:00.821343 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:02:00.851540 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:03:00.797017 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:03:00.797698 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:03:00.821327 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:03:00.843133 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:04:00.798177 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:04:00.798904 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:04:00.820282 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:04:00.842852 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:05:00.798323 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:05:00.799004 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:05:00.820630 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:05:00.841765 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:05:33.096194 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 11:05:33.116691 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Flow 'volume_create_manager' (6355da8b-03ee-4fd9-8f72-8a97c0c0154f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 11:05:33.123306 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f5a425-f439-4ef2-aa32-92e4cd456c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:05:33.141620 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f5a425-f439-4ef2-aa32-92e4cd456c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T11:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1430338722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ac7e4c82-340c-4a2e-be64-71a3e48b66c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dccab55a052648fbb6bbc3b93eaf849b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T11:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T11:05:33Z,use_quota=True,user_id='ea624fdbcf21473e8572542184a717df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:05:33.147158 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ecbf71-367f-482d-985f-18e2974c8077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:05:33.151668 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ecbf71-367f-482d-985f-18e2974c8077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:05:33.156921 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846fb037-e038-439e-8af1-16239d06f05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:05:33.241132 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846fb037-e038-439e-8af1-16239d06f05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac7e4c82-340c-4a2e-be64-71a3e48b66c8', 'volume_name': 'volume-ac7e4c82-340c-4a2e-be64-71a3e48b66c8', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:05:33.247468 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174f6fa1-5794-4745-8a37-f830b7344a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:05:33.250761 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174f6fa1-5794-4745-8a37-f830b7344a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:05:33.255555 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73288c02-ccaf-427c-8fd9-12a29ddee1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:05:33.256697 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Volume ac7e4c82-340c-4a2e-be64-71a3e48b66c8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac7e4c82-340c-4a2e-be64-71a3e48b66c8', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 11:05:33.257276 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Cloning ac7e4c82-340c-4a2e-be64-71a3e48b66c8 from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 11:05:33.265822 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 11:05:33.339406 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 11, 5, 33, 269772)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 11:05:33.339847 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 11:05:33.340250 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 11:05:33.344514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.079s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 11:05:33.345454 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 11:05:33.350922 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 11, 5, 33, 348731)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 11:05:33.351346 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 11:05:33.351744 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 11:05:33.363795 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:05:33.487957 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] creating snapshot='volume-ac7e4c82-340c-4a2e-be64-71a3e48b66c8.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 11:05:34.838397 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-ac7e4c82-340c-4a2e-be64-71a3e48b66c8.clone_snap' to 'volume-ac7e4c82-340c-4a2e-be64-71a3e48b66c8' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 11:05:35.814372 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 11:05:35.815606 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 11:05:35.815987 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 11:05:36.127946 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 11:05:36.128578 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Marking volume ac7e4c82-340c-4a2e-be64-71a3e48b66c8 as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 11:05:36.202966 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to ac7e4c82-340c-4a2e-be64-71a3e48b66c8. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 11:05:36.203359 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Creating volume glance metadata for volume ac7e4c82-340c-4a2e-be64-71a3e48b66c8 backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 11:05:36.300229 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73288c02-ccaf-427c-8fd9-12a29ddee1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7e4c82-340c-4a2e-be64-71a3e48b66c8', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:05:36.305026 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88fc15d9-3a57-45f6-ae39-1d0e3f40076d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:05:36.379497 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Volume volume-ac7e4c82-340c-4a2e-be64-71a3e48b66c8 (ac7e4c82-340c-4a2e-be64-71a3e48b66c8): created successfully May 02 11:05:36.383167 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88fc15d9-3a57-45f6-ae39-1d0e3f40076d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:05:36.388779 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Flow 'volume_create_manager' (6355da8b-03ee-4fd9-8f72-8a97c0c0154f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 11:05:36.470978 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-df866036-e1a9-497a-a7d0-c006540d8627 tempest-TestVolumeBackupRestore-2081214727 None] Created volume successfully. May 02 11:05:37.757715 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-76318d36-fd5a-4112-9641-52dab4fed878 tempest-TestVolumeBackupRestore-2081214727 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-02T11:05:37Z,data_timestamp=2022-05-02T11:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=26c2f375-6404-426f-bea1-0de87bbfde44,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='dccab55a052648fbb6bbc3b93eaf849b',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='ea624fdbcf21473e8572542184a717df',volume_id=ac7e4c82-340c-4a2e-be64-71a3e48b66c8) May 02 11:05:37.758490 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.backup.rpcapi [None req-76318d36-fd5a-4112-9641-52dab4fed878 tempest-TestVolumeBackupRestore-2081214727 None] continue_backup in rpcapi backup_id 26c2f375-6404-426f-bea1-0de87bbfde44 {{(pid=123784) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 02 11:05:37.870894 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-76318d36-fd5a-4112-9641-52dab4fed878 tempest-TestVolumeBackupRestore-2081214727 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 11:05:38.583550 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-76318d36-fd5a-4112-9641-52dab4fed878 tempest-TestVolumeBackupRestore-2081214727 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.712s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 11:05:38.584637 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-76318d36-fd5a-4112-9641-52dab4fed878 tempest-TestVolumeBackupRestore-2081214727 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ac7e4c82-340c-4a2e-be64-71a3e48b66c8', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'ac7e4c82-340c-4a2e-be64-71a3e48b66c8', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 11:05:38.602801 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-76318d36-fd5a-4112-9641-52dab4fed878 tempest-TestVolumeBackupRestore-2081214727 None] Initialize volume connection completed successfully. May 02 11:06:00.797851 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:06:00.799210 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:06:00.827071 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:06:00.854942 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:06:21.385493 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-76318d36-fd5a-4112-9641-52dab4fed878 tempest-TestVolumeBackupRestore-2081214727 None] Terminate volume connection completed successfully. May 02 11:06:21.426832 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-76318d36-fd5a-4112-9641-52dab4fed878 tempest-TestVolumeBackupRestore-2081214727 None] Remove volume export completed successfully. May 02 11:06:22.548676 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 11:06:22.568305 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Flow 'volume_create_manager' (491e71ce-234e-4121-9509-70de24f9b653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 11:06:22.575467 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976511e0-f868-4ff7-9e60-e4927e62fee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:06:22.590860 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976511e0-f868-4ff7-9e60-e4927e62fee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T11:06:22Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_26c2f375-6404-426f-bea1-0de87bbfde44',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6580c21e-356d-4737-8f55-bec015b2d872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dccab55a052648fbb6bbc3b93eaf849b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T11:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T11:06:22Z,use_quota=True,user_id='ea624fdbcf21473e8572542184a717df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:06:22.596233 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae33b1dd-4c39-4a35-bc2d-cf437302fe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:06:22.601583 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae33b1dd-4c39-4a35-bc2d-cf437302fe5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:06:22.606207 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aec56e4-6d04-4782-8233-cc8772e31c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:06:22.610287 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aec56e4-6d04-4782-8233-cc8772e31c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6580c21e-356d-4737-8f55-bec015b2d872', 'volume_name': 'volume-6580c21e-356d-4737-8f55-bec015b2d872', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:06:22.615212 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67dbb419-19e3-4f4a-9b25-4bc8a637bb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:06:22.619889 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67dbb419-19e3-4f4a-9b25-4bc8a637bb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:06:22.624622 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4bff9d-e58f-4e28-828b-48aa6acccb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:06:22.625685 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Volume 6580c21e-356d-4737-8f55-bec015b2d872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6580c21e-356d-4737-8f55-bec015b2d872', 'volume_size': 1} May 02 11:06:22.626081 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] creating volume 'volume-6580c21e-356d-4737-8f55-bec015b2d872' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 11:06:22.626834 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:06:23.161154 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 11:06:23.161570 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 11:06:23.165985 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4bff9d-e58f-4e28-828b-48aa6acccb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6580c21e-356d-4737-8f55-bec015b2d872', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:06:23.170652 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78e7be6-b574-4c4f-8a92-06948e4071f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:06:23.249673 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Volume volume-6580c21e-356d-4737-8f55-bec015b2d872 (6580c21e-356d-4737-8f55-bec015b2d872): created successfully May 02 11:06:23.253465 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78e7be6-b574-4c4f-8a92-06948e4071f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:06:23.259459 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Flow 'volume_create_manager' (491e71ce-234e-4121-9509-70de24f9b653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 11:06:23.341027 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Created volume successfully. May 02 11:06:23.531723 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 11:06:24.245497 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.713s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 11:06:24.246354 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6580c21e-356d-4737-8f55-bec015b2d872', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '6580c21e-356d-4737-8f55-bec015b2d872', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 11:06:24.261484 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Initialize volume connection completed successfully. May 02 11:07:00.800325 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:07:00.801292 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:07:00.825267 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:07:00.847147 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:07:06.067169 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Terminate volume connection completed successfully. May 02 11:07:06.083042 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-0fbb69da-cac2-45ff-a1ed-0369c783f171 tempest-TestVolumeBackupRestore-2081214727 None] Remove volume export completed successfully. May 02 11:07:12.410511 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-efac4489-2794-4841-8e81-9af23a55ac66 req-da3bc8eb-9a80-4ff2-ab66-5f4783b65f24 tempest-TestVolumeBackupRestore-2081214727 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 11:07:13.055917 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-efac4489-2794-4841-8e81-9af23a55ac66 req-da3bc8eb-9a80-4ff2-ab66-5f4783b65f24 tempest-TestVolumeBackupRestore-2081214727 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.645s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 11:07:13.057968 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-efac4489-2794-4841-8e81-9af23a55ac66 req-da3bc8eb-9a80-4ff2-ab66-5f4783b65f24 tempest-TestVolumeBackupRestore-2081214727 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6580c21e-356d-4737-8f55-bec015b2d872', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '6580c21e-356d-4737-8f55-bec015b2d872', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 11:07:13.124744 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-efac4489-2794-4841-8e81-9af23a55ac66 req-da3bc8eb-9a80-4ff2-ab66-5f4783b65f24 tempest-TestVolumeBackupRestore-2081214727 None] Connection info returned from driver {'name': 'volumes/volume-6580c21e-356d-4737-8f55-bec015b2d872', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6580c21e-356d-4737-8f55-bec015b2d872', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9e7800c9-c50e-4587-b250-89307704e496'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 11:07:13.237354 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-efac4489-2794-4841-8e81-9af23a55ac66 req-da3bc8eb-9a80-4ff2-ab66-5f4783b65f24 tempest-TestVolumeBackupRestore-2081214727 None] attachment_update completed successfully. May 02 11:08:00.802736 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:08:00.803663 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:08:00.826994 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:08:00.848775 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:09:00.804913 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:09:00.805723 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:09:00.827404 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:09:00.849248 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:10:00.804539 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:10:00.805283 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:10:00.826322 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:10:00.849024 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:11:00.804494 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:11:00.805181 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:11:00.827344 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:11:00.849423 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:12:00.804858 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:12:00.805573 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:12:00.829317 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:12:00.851566 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:12:24.718847 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-07a39b96-e16d-47cb-92bb-b69192e1b071 req-d0fc1204-6a9e-4ab0-8964-5d7296c45e61 tempest-TestVolumeBackupRestore-2081214727 None] Terminate volume connection completed successfully. May 02 11:12:24.719511 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-07a39b96-e16d-47cb-92bb-b69192e1b071 req-d0fc1204-6a9e-4ab0-8964-5d7296c45e61 tempest-TestVolumeBackupRestore-2081214727 None] Deleting attachment 9e7800c9-c50e-4587-b250-89307704e496. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 11:12:27.000863 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-4d224430-d41c-4b1d-9470-56cca636b785 tempest-TestVolumeBackupRestore-2081214727 None] Lock "b'cinder-6580c21e-356d-4737-8f55-bec015b2d872-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 11:12:27.088305 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d224430-d41c-4b1d-9470-56cca636b785 tempest-TestVolumeBackupRestore-2081214727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:12:29.054276 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d224430-d41c-4b1d-9470-56cca636b785 tempest-TestVolumeBackupRestore-2081214727 None] Volume volume-6580c21e-356d-4737-8f55-bec015b2d872 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 11:12:29.666606 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d224430-d41c-4b1d-9470-56cca636b785 tempest-TestVolumeBackupRestore-2081214727 None] deleting rbd volume volume-6580c21e-356d-4737-8f55-bec015b2d872 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 11:12:29.680701 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-24528de9-9330-4ba3-8cd7-467bfa55c381 tempest-TestVolumeBackupRestore-2081214727 None] Lock "b'cinder-ac7e4c82-340c-4a2e-be64-71a3e48b66c8-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 11:12:29.773450 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-24528de9-9330-4ba3-8cd7-467bfa55c381 tempest-TestVolumeBackupRestore-2081214727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:12:32.245094 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-24528de9-9330-4ba3-8cd7-467bfa55c381 tempest-TestVolumeBackupRestore-2081214727 None] deleting rbd volume volume-ac7e4c82-340c-4a2e-be64-71a3e48b66c8 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 11:12:39.017774 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-24528de9-9330-4ba3-8cd7-467bfa55c381 tempest-TestVolumeBackupRestore-2081214727 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 11:12:39.204514 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-24528de9-9330-4ba3-8cd7-467bfa55c381 tempest-TestVolumeBackupRestore-2081214727 None] deleting parent snapshot volume-ac7e4c82-340c-4a2e-be64-71a3e48b66c8.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 11:12:42.000129 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-24528de9-9330-4ba3-8cd7-467bfa55c381 tempest-TestVolumeBackupRestore-2081214727 None] Created reservations ['ef39bfac-d7dd-4838-b8c2-34d248f501c2', '1887337e-0e29-4267-be28-f2e874cc90d8', 'b8a929d7-8eb7-4c0f-9548-82795ddfa465', '7f0288d6-16a3-4cc0-b2c9-308b8142dd71'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 11:12:42.059813 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-4d224430-d41c-4b1d-9470-56cca636b785 tempest-TestVolumeBackupRestore-2081214727 None] Created reservations ['be78f3fe-4ddf-4026-9cd9-80ef280cdf89', 'd646b3b4-f7a2-4753-bf32-9f5f2d01dda8', 'dc78de14-7b0c-4893-b934-8355b360aa09', 'edbd31ac-8c1a-4562-8c7b-45b4a9263da0'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 11:12:42.142836 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-24528de9-9330-4ba3-8cd7-467bfa55c381 tempest-TestVolumeBackupRestore-2081214727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:12:42.165245 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-24528de9-9330-4ba3-8cd7-467bfa55c381 tempest-TestVolumeBackupRestore-2081214727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:12:42.188115 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-24528de9-9330-4ba3-8cd7-467bfa55c381 tempest-TestVolumeBackupRestore-2081214727 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:12:42.194760 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-24528de9-9330-4ba3-8cd7-467bfa55c381 tempest-TestVolumeBackupRestore-2081214727 None] Deleted volume successfully. May 02 11:12:42.257992 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-24528de9-9330-4ba3-8cd7-467bfa55c381 tempest-TestVolumeBackupRestore-2081214727 None] Lock "b'cinder-ac7e4c82-340c-4a2e-be64-71a3e48b66c8-delete_volume'" released by "delete_volume" :: held 12.577s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 11:12:42.282920 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d224430-d41c-4b1d-9470-56cca636b785 tempest-TestVolumeBackupRestore-2081214727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:12:42.349379 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d224430-d41c-4b1d-9470-56cca636b785 tempest-TestVolumeBackupRestore-2081214727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:12:42.372755 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-4d224430-d41c-4b1d-9470-56cca636b785 tempest-TestVolumeBackupRestore-2081214727 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:12:42.376660 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4d224430-d41c-4b1d-9470-56cca636b785 tempest-TestVolumeBackupRestore-2081214727 None] Deleted volume successfully. May 02 11:12:42.476288 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-4d224430-d41c-4b1d-9470-56cca636b785 tempest-TestVolumeBackupRestore-2081214727 None] Lock "b'cinder-6580c21e-356d-4737-8f55-bec015b2d872-delete_volume'" released by "delete_volume" :: held 15.475s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 11:13:00.808066 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:13:00.808800 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:13:00.831706 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:13:00.855678 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:14:00.810352 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:14:00.811039 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:14:00.832299 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:14:00.854033 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:15:00.808833 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:15:00.809545 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:15:00.831115 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:15:00.852980 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:16:00.809328 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:16:00.810382 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:16:00.832002 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:16:00.854728 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:17:00.810232 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:17:00.814693 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:17:00.832504 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:17:00.854216 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:18:00.809759 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:18:00.810431 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:18:00.832797 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:18:00.854253 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:19:00.809216 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:19:00.810790 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:19:00.839650 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:19:00.881509 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:19:10.456321 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 11:19:10.477330 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Flow 'volume_create_manager' (1947207c-76aa-4c6b-9b4a-b201571f1690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 11:19:10.484145 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1504a93-bebd-416b-ac65-c4ce3b1b5cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:19:10.499703 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1504a93-bebd-416b-ac65-c4ce3b1b5cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T11:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1399407214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a508e0d2-4fc7-4013-b7bb-42052e5f5089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9461ec4cf54a98ab67b4c860d3b6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T11:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T11:19:10Z,use_quota=True,user_id='54222a689c0c4006b33913f18f33be09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:19:10.505164 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e8f113-59d1-4640-a5e1-3346e0ece64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:19:10.509863 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e8f113-59d1-4640-a5e1-3346e0ece64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:19:10.515091 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40304461-d7c8-4a51-9e5e-25a045d3cdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:19:10.519214 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40304461-d7c8-4a51-9e5e-25a045d3cdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'volume_name': 'volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:19:10.524845 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6808aa-7d1f-44a6-94c1-31b0237ea042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:19:10.528729 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6808aa-7d1f-44a6-94c1-31b0237ea042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:19:10.533739 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caaf946-2316-4eff-a007-464699206f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:19:10.534804 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Volume a508e0d2-4fc7-4013-b7bb-42052e5f5089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'volume_size': 1} May 02 11:19:10.535205 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] creating volume 'volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 11:19:10.536019 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:19:10.949027 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 11:19:10.949409 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 11:19:10.953239 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caaf946-2316-4eff-a007-464699206f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:19:10.958123 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75877182-05eb-4fee-a05f-954cdfd54264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:19:11.014067 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Volume volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089 (a508e0d2-4fc7-4013-b7bb-42052e5f5089): created successfully May 02 11:19:11.017722 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75877182-05eb-4fee-a05f-954cdfd54264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:19:11.023258 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Flow 'volume_create_manager' (1947207c-76aa-4c6b-9b4a-b201571f1690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 11:19:11.071142 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-c6142625-ba81-49a6-9fc5-958353a858ab tempest-ServerActionsTestJSON-1412520725 None] Created volume successfully. May 02 11:19:12.149296 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-d3d9092d-3a1b-45f6-992b-8369e097c3b3 req-b1910b11-2ce6-4939-b44c-ed2dd496ea40 tempest-ServerActionsTestJSON-1412520725 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 11:19:12.775186 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-d3d9092d-3a1b-45f6-992b-8369e097c3b3 req-b1910b11-2ce6-4939-b44c-ed2dd496ea40 tempest-ServerActionsTestJSON-1412520725 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.625s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 11:19:12.775921 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-d3d9092d-3a1b-45f6-992b-8369e097c3b3 req-b1910b11-2ce6-4939-b44c-ed2dd496ea40 tempest-ServerActionsTestJSON-1412520725 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 11:19:12.865483 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-d3d9092d-3a1b-45f6-992b-8369e097c3b3 req-b1910b11-2ce6-4939-b44c-ed2dd496ea40 tempest-ServerActionsTestJSON-1412520725 None] Connection info returned from driver {'name': 'volumes/volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3ac82483-9153-4248-b8c0-da7cc22e34c1'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 11:19:13.003272 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-d3d9092d-3a1b-45f6-992b-8369e097c3b3 req-b1910b11-2ce6-4939-b44c-ed2dd496ea40 tempest-ServerActionsTestJSON-1412520725 None] attachment_update completed successfully. May 02 11:19:36.464150 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-6fc2ef4c-7ef0-442b-9c6d-f52f1493a6a1 req-fd2cab70-63aa-4090-945f-68bcecb985b2 tempest-ServerActionsTestJSON-1412520725 None] Terminate volume connection completed successfully. May 02 11:19:36.464874 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-6fc2ef4c-7ef0-442b-9c6d-f52f1493a6a1 req-fd2cab70-63aa-4090-945f-68bcecb985b2 tempest-ServerActionsTestJSON-1412520725 None] Deleting attachment 3ac82483-9153-4248-b8c0-da7cc22e34c1. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 11:19:39.074194 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-6fc2ef4c-7ef0-442b-9c6d-f52f1493a6a1 req-e10baf56-ed52-45cd-ad90-56eccf2a42fb tempest-ServerActionsTestJSON-1412520725 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 11:19:39.697816 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-6fc2ef4c-7ef0-442b-9c6d-f52f1493a6a1 req-e10baf56-ed52-45cd-ad90-56eccf2a42fb tempest-ServerActionsTestJSON-1412520725 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.623s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 11:19:39.698672 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-6fc2ef4c-7ef0-442b-9c6d-f52f1493a6a1 req-e10baf56-ed52-45cd-ad90-56eccf2a42fb tempest-ServerActionsTestJSON-1412520725 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 11:19:39.778050 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-6fc2ef4c-7ef0-442b-9c6d-f52f1493a6a1 req-e10baf56-ed52-45cd-ad90-56eccf2a42fb tempest-ServerActionsTestJSON-1412520725 None] Connection info returned from driver {'name': 'volumes/volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '091b72fe-f17d-4e97-b85e-eee6d8ce1a77'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 11:19:39.889696 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-6fc2ef4c-7ef0-442b-9c6d-f52f1493a6a1 req-e10baf56-ed52-45cd-ad90-56eccf2a42fb tempest-ServerActionsTestJSON-1412520725 None] attachment_update completed successfully. May 02 11:19:48.242642 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-ae691bfc-a005-4a06-bccc-6643a076d9b3 req-25c83049-a47b-4753-a91b-286e1dd6aa92 tempest-ServerActionsTestJSON-1412520725 None] Terminate volume connection completed successfully. May 02 11:19:48.243295 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-ae691bfc-a005-4a06-bccc-6643a076d9b3 req-25c83049-a47b-4753-a91b-286e1dd6aa92 tempest-ServerActionsTestJSON-1412520725 None] Deleting attachment 091b72fe-f17d-4e97-b85e-eee6d8ce1a77. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 11:19:51.248241 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-ae691bfc-a005-4a06-bccc-6643a076d9b3 req-ef4be715-3fa3-4959-8cfe-00dc9e22fea0 tempest-ServerActionsTestJSON-1412520725 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 11:19:51.978115 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-ae691bfc-a005-4a06-bccc-6643a076d9b3 req-ef4be715-3fa3-4959-8cfe-00dc9e22fea0 tempest-ServerActionsTestJSON-1412520725 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.730s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 11:19:51.978951 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-ae691bfc-a005-4a06-bccc-6643a076d9b3 req-ef4be715-3fa3-4959-8cfe-00dc9e22fea0 tempest-ServerActionsTestJSON-1412520725 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 11:19:52.109372 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-ae691bfc-a005-4a06-bccc-6643a076d9b3 req-ef4be715-3fa3-4959-8cfe-00dc9e22fea0 tempest-ServerActionsTestJSON-1412520725 None] Connection info returned from driver {'name': 'volumes/volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a508e0d2-4fc7-4013-b7bb-42052e5f5089', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3b239202-e896-493b-b183-1aad497a82f8'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 11:19:52.248735 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-ae691bfc-a005-4a06-bccc-6643a076d9b3 req-ef4be715-3fa3-4959-8cfe-00dc9e22fea0 tempest-ServerActionsTestJSON-1412520725 None] attachment_update completed successfully. May 02 11:19:59.715819 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-64ce244d-b086-406d-8e01-ff940467f139 req-bcd0d8bb-7a2c-4018-909f-45b9b8632e87 tempest-ServerActionsTestJSON-1412520725 None] Terminate volume connection completed successfully. May 02 11:19:59.716497 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-64ce244d-b086-406d-8e01-ff940467f139 req-bcd0d8bb-7a2c-4018-909f-45b9b8632e87 tempest-ServerActionsTestJSON-1412520725 None] Deleting attachment 3b239202-e896-493b-b183-1aad497a82f8. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 11:20:01.970560 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-4d4f74b4-f5ab-4e6c-8d18-2facfe579641 tempest-ServerActionsTestJSON-1412520725 None] Lock "b'cinder-a508e0d2-4fc7-4013-b7bb-42052e5f5089-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 11:20:02.112297 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d4f74b4-f5ab-4e6c-8d18-2facfe579641 tempest-ServerActionsTestJSON-1412520725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:20:02.285407 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d4f74b4-f5ab-4e6c-8d18-2facfe579641 tempest-ServerActionsTestJSON-1412520725 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 11:20:02.285810 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d4f74b4-f5ab-4e6c-8d18-2facfe579641 tempest-ServerActionsTestJSON-1412520725 None] Volume volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089 is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 11:20:02.400462 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d4f74b4-f5ab-4e6c-8d18-2facfe579641 tempest-ServerActionsTestJSON-1412520725 None] deleting rbd volume volume-a508e0d2-4fc7-4013-b7bb-42052e5f5089 {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 11:20:06.508960 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-4d4f74b4-f5ab-4e6c-8d18-2facfe579641 tempest-ServerActionsTestJSON-1412520725 None] Created reservations ['1c8b86eb-9b6a-42af-919b-91cf85abe2af', 'd93b2f85-baed-4f38-a019-16cea5ef08dc', 'f8ff6624-d7ba-4887-b432-1decdabe0ed5', '14e6f5c1-b215-495f-b4f8-6893d7b72695'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 11:20:06.705049 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d4f74b4-f5ab-4e6c-8d18-2facfe579641 tempest-ServerActionsTestJSON-1412520725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:20:06.728018 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-4d4f74b4-f5ab-4e6c-8d18-2facfe579641 tempest-ServerActionsTestJSON-1412520725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:20:06.750225 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-4d4f74b4-f5ab-4e6c-8d18-2facfe579641 tempest-ServerActionsTestJSON-1412520725 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:20:06.754407 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-4d4f74b4-f5ab-4e6c-8d18-2facfe579641 tempest-ServerActionsTestJSON-1412520725 None] Deleted volume successfully. May 02 11:20:06.863087 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-4d4f74b4-f5ab-4e6c-8d18-2facfe579641 tempest-ServerActionsTestJSON-1412520725 None] Lock "b'cinder-a508e0d2-4fc7-4013-b7bb-42052e5f5089-delete_volume'" released by "delete_volume" :: held 4.892s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 11:21:00.819269 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:21:00.819269 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:21:00.858267 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:21:00.889042 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:22:00.815156 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:22:00.817769 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:22:00.878950 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:22:00.921126 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:22:11.755958 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 11:22:11.776477 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Flow 'volume_create_manager' (62a6ca9d-6ec8-4b3b-940d-12bc316d45de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 11:22:11.783359 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0928bdc0-3d96-41da-bde2-b41bb625ecdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:22:11.799027 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0928bdc0-3d96-41da-bde2-b41bb625ecdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T11:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-757793554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ee3fd193-cb05-4cee-9833-306bcde1a2af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05546126f6f4cb1912284d9801d37e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T11:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T11:22:12Z,use_quota=True,user_id='9e44df8ee3f5405b9e9667b6b97568d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:22:11.804436 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1200fdb8-2a8a-481c-835f-a1b444225853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:22:11.808567 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1200fdb8-2a8a-481c-835f-a1b444225853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:22:11.813842 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35ba6bf-d633-4c8c-8b0c-e0e90a3461ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:22:11.817930 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35ba6bf-d633-4c8c-8b0c-e0e90a3461ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3fd193-cb05-4cee-9833-306bcde1a2af', 'volume_name': 'volume-ee3fd193-cb05-4cee-9833-306bcde1a2af', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:22:11.822856 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cde8b91-c521-423a-95ca-2c35cae9651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:22:11.826784 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cde8b91-c521-423a-95ca-2c35cae9651a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:22:11.831522 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d352b1ac-b659-4168-815d-f207d9e0772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:22:11.832718 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Volume ee3fd193-cb05-4cee-9833-306bcde1a2af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3fd193-cb05-4cee-9833-306bcde1a2af', 'volume_size': 1} May 02 11:22:11.833114 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] creating volume 'volume-ee3fd193-cb05-4cee-9833-306bcde1a2af' {{(pid=123784) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 02 11:22:11.833905 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:22:12.446456 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 11:22:12.447352 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 11:22:12.451209 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d352b1ac-b659-4168-815d-f207d9e0772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3fd193-cb05-4cee-9833-306bcde1a2af', 'volume_size': 1}' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:22:12.455891 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc0f8e3-f59b-4069-9072-104788e63f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:22:12.537019 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Volume volume-ee3fd193-cb05-4cee-9833-306bcde1a2af (ee3fd193-cb05-4cee-9833-306bcde1a2af): created successfully May 02 11:22:12.540797 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc0f8e3-f59b-4069-9072-104788e63f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:22:12.546567 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Flow 'volume_create_manager' (62a6ca9d-6ec8-4b3b-940d-12bc316d45de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 11:22:12.657212 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-32f177ab-e167-40d1-8a92-196f932fa32c tempest-TestMinimumBasicScenario-757864973 None] Created volume successfully. May 02 11:22:14.673758 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-451fa566-8cbc-4aa6-a9ef-9f56ed450829 req-c5147334-614a-4738-9cbd-38a2f68933e8 tempest-TestMinimumBasicScenario-757864973 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 11:22:15.632876 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-451fa566-8cbc-4aa6-a9ef-9f56ed450829 req-c5147334-614a-4738-9cbd-38a2f68933e8 tempest-TestMinimumBasicScenario-757864973 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.959s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 11:22:15.633820 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-451fa566-8cbc-4aa6-a9ef-9f56ed450829 req-c5147334-614a-4738-9cbd-38a2f68933e8 tempest-TestMinimumBasicScenario-757864973 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ee3fd193-cb05-4cee-9833-306bcde1a2af', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': 'ee3fd193-cb05-4cee-9833-306bcde1a2af', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 11:22:15.714379 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-451fa566-8cbc-4aa6-a9ef-9f56ed450829 req-c5147334-614a-4738-9cbd-38a2f68933e8 tempest-TestMinimumBasicScenario-757864973 None] Connection info returned from driver {'name': 'volumes/volume-ee3fd193-cb05-4cee-9833-306bcde1a2af', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ee3fd193-cb05-4cee-9833-306bcde1a2af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5f9324f4-6f92-4887-a1b7-3882a9488ad7'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 11:22:15.836806 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-451fa566-8cbc-4aa6-a9ef-9f56ed450829 req-c5147334-614a-4738-9cbd-38a2f68933e8 tempest-TestMinimumBasicScenario-757864973 None] attachment_update completed successfully. May 02 11:23:00.816094 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:23:00.817075 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:23:00.844295 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:23:00.866682 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:23:29.157732 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-2915d44e-a105-4cac-b2d6-128816a8c337 req-a0c48eaa-a4c9-4de2-8248-7370049d65f8 tempest-TestMinimumBasicScenario-757864973 None] Terminate volume connection completed successfully. May 02 11:23:29.158780 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-2915d44e-a105-4cac-b2d6-128816a8c337 req-a0c48eaa-a4c9-4de2-8248-7370049d65f8 tempest-TestMinimumBasicScenario-757864973 None] Deleting attachment 5f9324f4-6f92-4887-a1b7-3882a9488ad7. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 11:23:29.921786 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f77ac088-3337-4031-9eca-c9a4a8901243 tempest-TestMinimumBasicScenario-757864973 None] Lock "b'cinder-ee3fd193-cb05-4cee-9833-306bcde1a2af-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 11:23:30.071133 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f77ac088-3337-4031-9eca-c9a4a8901243 tempest-TestMinimumBasicScenario-757864973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:23:30.214212 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f77ac088-3337-4031-9eca-c9a4a8901243 tempest-TestMinimumBasicScenario-757864973 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 11:23:30.214850 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f77ac088-3337-4031-9eca-c9a4a8901243 tempest-TestMinimumBasicScenario-757864973 None] Volume volume-ee3fd193-cb05-4cee-9833-306bcde1a2af is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 11:23:30.362899 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f77ac088-3337-4031-9eca-c9a4a8901243 tempest-TestMinimumBasicScenario-757864973 None] deleting rbd volume volume-ee3fd193-cb05-4cee-9833-306bcde1a2af {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 11:23:34.239546 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [None req-f77ac088-3337-4031-9eca-c9a4a8901243 tempest-TestMinimumBasicScenario-757864973 None] Created reservations ['3271362d-31ae-4585-8b77-0260c00ab45c', '7a726bd4-4ff4-40b2-a1fe-5b6cd4e86bd4', '164d9bf0-2d1b-478e-ba60-a4a0085046e9', '6678bf10-8a75-473f-bf7a-e3efadcb6a15'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 11:23:34.492071 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f77ac088-3337-4031-9eca-c9a4a8901243 tempest-TestMinimumBasicScenario-757864973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:23:34.514621 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-f77ac088-3337-4031-9eca-c9a4a8901243 tempest-TestMinimumBasicScenario-757864973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:23:34.537058 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-f77ac088-3337-4031-9eca-c9a4a8901243 tempest-TestMinimumBasicScenario-757864973 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:23:34.541261 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-f77ac088-3337-4031-9eca-c9a4a8901243 tempest-TestMinimumBasicScenario-757864973 None] Deleted volume successfully. May 02 11:23:34.618252 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-f77ac088-3337-4031-9eca-c9a4a8901243 tempest-TestMinimumBasicScenario-757864973 None] Lock "b'cinder-ee3fd193-cb05-4cee-9833-306bcde1a2af-delete_volume'" released by "delete_volume" :: held 4.697s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 11:24:00.821998 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:24:00.822688 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:24:00.854654 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:24:00.904695 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:25:00.823673 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:25:00.824443 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:25:00.849057 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:25:00.870621 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:26:00.825322 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:26:00.826010 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:26:00.847033 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:26:00.868651 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:27:00.823512 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:27:00.824195 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:27:00.845538 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:27:00.870081 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:28:00.825509 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:28:00.826215 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:28:00.848164 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:28:00.869747 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:29:00.824568 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:29:00.825259 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:29:00.859232 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:29:00.883881 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:30:00.829628 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:30:00.830329 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:30:00.851746 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:30:00.874239 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:31:00.829052 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:31:00.829821 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:31:00.866179 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:31:00.915662 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:32:00.831597 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:32:00.835129 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:32:00.864526 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:32:00.905000 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:33:00.835366 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:33:00.835985 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:33:00.859286 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:33:00.881105 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:34:00.836523 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:34:00.837275 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:34:00.859025 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:34:00.880898 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:35:00.837191 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:35:00.838278 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:35:00.860644 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:35:00.914351 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:36:00.839646 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:36:00.840331 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:36:00.897599 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:36:00.919891 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:36:35.456561 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123784) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 02 11:36:35.475569 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Flow 'volume_create_manager' (71047457-a3c2-447e-b212-2897dcdb8581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 11:36:35.482747 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e5fa97-f1d4-4050-87a0-186782842f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:36:35.498125 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e5fa97-f1d4-4050-87a0-186782842f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-02T11:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1924849463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2c405fbf-b90e-4037-ace5-360447cf449a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31245ef5b6547f2b9769a9462c0b6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-02T11:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-02T11:36:35Z,use_quota=True,user_id='7789236e7c354cbe931946ef3b145175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4511150c-727c-4433-9645-06cd78957646),volume_type_id=4511150c-727c-4433-9645-06cd78957646)' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:36:35.503780 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829b354f-6d66-48b5-b638-f58b388b04ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:36:35.507677 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829b354f-6d66-48b5-b638-f58b388b04ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:36:35.512940 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a40ed56-ae28-42e7-989c-04a698174418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:36:35.593415 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a40ed56-ae28-42e7-989c-04a698174418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c405fbf-b90e-4037-ace5-360447cf449a', 'volume_name': 'volume-2c405fbf-b90e-4037-ace5-360447cf449a', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:36:35.598598 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5986bad6-9da6-4cf8-8ec9-79c2dce2cb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:36:35.603240 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5986bad6-9da6-4cf8-8ec9-79c2dce2cb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:36:35.608116 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dea9c2b-d7cb-4d81-89b1-a0c42dbda9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:36:35.609273 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Volume 2c405fbf-b90e-4037-ace5-360447cf449a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c405fbf-b90e-4037-ace5-360447cf449a', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 02 11:36:35.609857 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Cloning 2c405fbf-b90e-4037-ace5-360447cf449a from image afdfe80f-453b-40fc-ae29-550b735758e3 at location (None, None). {{(pid=123784) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 02 11:36:35.617624 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 11:36:35.677843 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 11, 36, 35, 621472)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 11:36:35.678288 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 11:36:35.678702 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Found cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 02 11:36:35.682985 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Lock "b'cinder-afdfe80f-453b-40fc-ae29-550b735758e3'" released by "_prepare_image_cache_entry" :: held 0.065s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 11:36:35.683932 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Attempting to retrieve cache entry for image = afdfe80f-453b-40fc-ae29-550b735758e3 on host ncdv-master-1@ceph#ceph. {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 02 11:36:35.689781 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Found image-volume cache entry: {'id': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'volume_id': 'ba46b094-918c-4aa2-b6bc-591c699050b1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14), 'last_used': datetime.datetime(2022, 5, 2, 11, 36, 35, 687496)}. {{(pid=123784) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 02 11:36:35.692670 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.image.cache [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Image-volume cache entry image_update_at = 2022-05-02 10:10:14+00:00, requested image updated_at = 2022-05-02 10:10:14+00:00. {{(pid=123784) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 02 11:36:35.692670 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Creating from source image-volume ba46b094-918c-4aa2-b6bc-591c699050b1 {{(pid=123784) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 02 11:36:35.701871 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:36:35.986364 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] creating snapshot='volume-2c405fbf-b90e-4037-ace5-360447cf449a.clone_snap' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 02 11:36:37.654911 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] cloning 'volume-ba46b094-918c-4aa2-b6bc-591c699050b1@volume-2c405fbf-b90e-4037-ace5-360447cf449a.clone_snap' to 'volume-2c405fbf-b90e-4037-ace5-360447cf449a' {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 02 11:36:38.567632 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Volume volume-1cbc9d75-d395-469f-815a-9f92db5893d4.deleted is not a clone. {{(pid=123784) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 02 11:36:38.568743 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 02 11:36:38.569127 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123784) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 02 11:36:38.813620 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] clone created successfully {{(pid=123784) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 02 11:36:38.814364 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.volume_utils [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Marking volume 2c405fbf-b90e-4037-ace5-360447cf449a as bootable. {{(pid=123784) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 02 11:36:38.861268 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Copying metadata from image afdfe80f-453b-40fc-ae29-550b735758e3 to 2c405fbf-b90e-4037-ace5-360447cf449a. {{(pid=123784) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 02 11:36:38.861705 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.flows.manager.create_volume [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Creating volume glance metadata for volume 2c405fbf-b90e-4037-ace5-360447cf449a backed by image afdfe80f-453b-40fc-ae29-550b735758e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123784) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 02 11:36:38.984135 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dea9c2b-d7cb-4d81-89b1-a0c42dbda9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c405fbf-b90e-4037-ace5-360447cf449a', 'volume_size': 1, 'image_id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3af81e2baeae46b0b67902cedc893eb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'afdfe80f-453b-40fc-ae29-550b735758e3', 'created_at': datetime.datetime(2022, 5, 2, 10, 9, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 2, 10, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afdfe80f-453b-40fc-ae29-550b735758e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:36:38.988780 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d7be72-2346-48b5-8745-122c7a09da81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 02 11:36:39.049395 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.flows.manager.create_volume [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Volume volume-2c405fbf-b90e-4037-ace5-360447cf449a (2c405fbf-b90e-4037-ace5-360447cf449a): created successfully May 02 11:36:39.052931 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d7be72-2346-48b5-8745-122c7a09da81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123784) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 02 11:36:39.059188 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Flow 'volume_create_manager' (71047457-a3c2-447e-b212-2897dcdb8581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123784) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 02 11:36:39.134933 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [None req-826d7d09-6d57-4a1d-9f30-d8c5f3a42502 tempest-TestShelveInstance-887731847 None] Created volume successfully. May 02 11:36:42.653715 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-ecfe75fd-d588-4004-ab91-385d9fdb65a2 req-6ad22e4f-6a1b-494d-8943-ee24cb41eb88 tempest-TestShelveInstance-887731847 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 02 11:36:43.711903 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_concurrency.processutils [req-ecfe75fd-d588-4004-ab91-385d9fdb65a2 req-6ad22e4f-6a1b-494d-8943-ee24cb41eb88 tempest-TestShelveInstance-887731847 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.058s {{(pid=123784) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 02 11:36:43.712752 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-ecfe75fd-d588-4004-ab91-385d9fdb65a2 req-6ad22e4f-6a1b-494d-8943-ee24cb41eb88 tempest-TestShelveInstance-887731847 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2c405fbf-b90e-4037-ace5-360447cf449a', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'f5809a2c-f35a-4b72-b096-a4cf6b0e2893', 'volume_id': '2c405fbf-b90e-4037-ace5-360447cf449a', 'discard': True}} {{(pid=123784) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 02 11:36:43.787197 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-ecfe75fd-d588-4004-ab91-385d9fdb65a2 req-6ad22e4f-6a1b-494d-8943-ee24cb41eb88 tempest-TestShelveInstance-887731847 None] Connection info returned from driver {'name': 'volumes/volume-2c405fbf-b90e-4037-ace5-360447cf449a', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2c405fbf-b90e-4037-ace5-360447cf449a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a3ebe55c-bad8-4edf-a459-965b0ac17b55'} {{(pid=123784) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 02 11:36:43.906119 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-ecfe75fd-d588-4004-ab91-385d9fdb65a2 req-6ad22e4f-6a1b-494d-8943-ee24cb41eb88 tempest-TestShelveInstance-887731847 None] attachment_update completed successfully. May 02 11:37:00.845592 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:37:00.846513 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:37:00.870120 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:37:00.893169 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:38:00.848058 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:38:00.848774 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:38:00.872233 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:38:00.896381 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:39:00.851670 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:39:00.852425 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:39:00.874314 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:39:00.896583 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:40:00.851469 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:40:00.852121 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:40:00.953606 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:40:00.977668 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:40:19.759711 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-f5620df5-3136-48a7-985c-f7b6f0c20121 tempest-TestShelveInstance-887731847 None] Terminate volume connection completed successfully. May 02 11:40:19.760334 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.manager [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-f5620df5-3136-48a7-985c-f7b6f0c20121 tempest-TestShelveInstance-887731847 None] Deleting attachment a3ebe55c-bad8-4edf-a459-965b0ac17b55. {{(pid=123784) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 02 11:40:20.095757 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-71f8348b-27d4-46d4-8e68-a12ca9dedbcc tempest-TestShelveInstance-887731847 None] Lock "b'cinder-2c405fbf-b90e-4037-ace5-360447cf449a-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 02 11:40:20.179222 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-71f8348b-27d4-46d4-8e68-a12ca9dedbcc tempest-TestShelveInstance-887731847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:40:20.336347 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-71f8348b-27d4-46d4-8e68-a12ca9dedbcc tempest-TestShelveInstance-887731847 None] volume has no backup snaps {{(pid=123784) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 02 11:40:20.425517 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-71f8348b-27d4-46d4-8e68-a12ca9dedbcc tempest-TestShelveInstance-887731847 None] deleting rbd volume volume-2c405fbf-b90e-4037-ace5-360447cf449a {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 02 11:40:24.063493 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-71f8348b-27d4-46d4-8e68-a12ca9dedbcc tempest-TestShelveInstance-887731847 None] volume is a clone so cleaning references {{(pid=123784) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 02 11:40:24.195657 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-71f8348b-27d4-46d4-8e68-a12ca9dedbcc tempest-TestShelveInstance-887731847 None] deleting parent snapshot volume-2c405fbf-b90e-4037-ace5-360447cf449a.clone_snap {{(pid=123784) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 02 11:40:26.279519 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.quota [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-71f8348b-27d4-46d4-8e68-a12ca9dedbcc tempest-TestShelveInstance-887731847 None] Created reservations ['5a938a5a-dbfa-4159-93db-d4b1d2df713b', '87aba517-abe1-4ba2-a555-fe60f3467d55', '6d819883-3af8-474f-b2f9-b5ce3a8e4334', '700fb3bd-c946-4328-bb89-c0175b08e925'] {{(pid=123784) reserve /opt/stack/cinder/cinder/quota.py:755}} May 02 11:40:26.464869 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-71f8348b-27d4-46d4-8e68-a12ca9dedbcc tempest-TestShelveInstance-887731847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:40:26.549336 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-71f8348b-27d4-46d4-8e68-a12ca9dedbcc tempest-TestShelveInstance-887731847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:40:26.573135 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-71f8348b-27d4-46d4-8e68-a12ca9dedbcc tempest-TestShelveInstance-887731847 None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:40:26.579166 ncdv-master-1 cinder-volume[123784]: INFO cinder.volume.manager [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-71f8348b-27d4-46d4-8e68-a12ca9dedbcc tempest-TestShelveInstance-887731847 None] Deleted volume successfully. May 02 11:40:26.654901 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.coordination [req-eb378e72-1683-4ad6-b7bb-25c4bde9effc req-71f8348b-27d4-46d4-8e68-a12ca9dedbcc tempest-TestShelveInstance-887731847 None] Lock "b'cinder-2c405fbf-b90e-4037-ace5-360447cf449a-delete_volume'" released by "delete_volume" :: held 6.559s {{(pid=123784) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 02 11:41:00.852963 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:41:00.853653 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:41:00.875365 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:41:00.898420 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:42:00.852890 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:42:00.853637 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:42:00.876967 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:42:00.898987 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:43:00.854898 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:43:00.855636 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:43:00.878566 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:43:00.902654 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:44:00.857913 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:44:00.858661 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:44:00.880763 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:44:00.903721 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:45:00.859309 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:45:00.859984 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:45:00.881342 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:45:00.909601 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:46:00.864351 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:46:00.865135 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:46:00.886643 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:46:00.909322 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:47:00.863862 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:47:00.864551 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:47:00.903453 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:47:00.937232 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:48:00.862618 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:48:00.863291 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:48:00.890236 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:48:00.913437 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:49:00.868195 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:49:00.868916 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:49:00.890414 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:49:00.976775 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:50:00.872243 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:50:00.872953 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:50:00.894916 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:50:00.918325 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:51:00.874526 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:51:00.875295 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:51:00.897949 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:51:00.922554 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:52:00.877793 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:52:00.878467 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:52:00.901661 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:52:00.924888 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 02 11:53:00.880592 ncdv-master-1 cinder-volume[123784]: DEBUG oslo_service.periodic_task [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123784) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 02 11:53:00.881291 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:53:00.902710 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.volume.drivers.rbd [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123784) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 02 11:53:00.927511 ncdv-master-1 cinder-volume[123784]: DEBUG cinder.manager [None req-44de490c-7872-45ea-9266-f04c24afb22c None None] Notifying Schedulers of capabilities ... {{(pid=123784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}